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Appendix A. Methodology 


Data Sources 


Data collection included district and teacher surveys and six case studies: 


The district survey obtained information on the technology and student background context of the 
district and information related to the use of digital learning resources (DLRs). The data on use of DLRs 
addressed sources for identifying DLRs, criteria for selecting DLRs, the types of DLRs used, measures 
used to assess effectiveness of the district’s DLR use, professional development (PD) provided to 
teachers on DLR use, other supports for use of DLRs for instruction, and factors identified as barriers to 
DLR use in the district. 


The teacher survey obtained information on teachers’ background and experience, their students 
taught, and practices in identifying, selecting and using DLRs with their students. Teachers also provided 
information on professional development and other supports for DLR use, on factors that were barriers 
to their DLR use, their perspectives on DLR outcomes, and measures they used to assess the 
effectiveness of their students’ DLR use. 


Both surveys consisted primarily of closed-ended items but included a small number of open-ended 
items to elicit examples of specific DLRs used and comments on gaps and needs related to DLRs. 


Study staff conducted six district case studies that included interviews with district and school staff, DLR 
demonstrations, and classroom observations. Key district personnel, including the director of curriculum 
and instruction, the director of EL services and the director of technology participated in interviews. At 
each school, the principal, instructional or technology coaches and EL services coordinators (where 
those positions existed), and three to five teachers of EL students, including both mainstream teachers 
of ELs and EL specialists, participated in interviews. Teacher interviews also included a DLR 
demonstration when teachers indicated they used technology for instruction, and in each site, the study 
team conducted observations in one to two classrooms. 


District and Teacher Survey Samples 


District Sample 


The sample design for the district survey was a nationally representative stratified random sample of 
999 school districts that served at least one EL student, as identified in the 2013-14 National Center of 
Education Statistics (NCES) Common Core of Data (CCD) Local Education Agency Universe File. Districts 
were identified into one of three strata for level of EL-student representation (Exhibit A-1) using the 
following criteria: 
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e —_ High-EL districts enrolled more than 1,000 EL students and the percentage of EL students in 
the district was 10 percent or more of the total student population. 

e Moderate EL districts enrolled either between 101 and 1,000 EL students, or more than 1,000 
EL students with the EL students comprising less than 10 percent of the total student 
enrollment. 


e Low-EL districts included all districts that enrolled 100 or fewer EL students. 
Exhibit A-1. U.S. public school districts 2013-14 that enrolled EL students: number of districts, 


percentage of districts, number of EL students, and total number of students enrolled, in 
three categories of EL student representation 


Number Percentage Number of Total number of 
Category of districts of districts EL students students 
High-EL districts 624 6 3,045,683 14,233,565 
Moderate-EL districts 2,645 24 1,251,274 20,624,534 
Low-EL districts 7,700 70 178,929 15,500,218 
Total 10,969 100 4,475,886 50,358,317 


Exhibit reads: There were 624 high-EL districts, representing 6 percent of U.S. public school districts that enrolled 
EL students in 2013-14, with 3,045,683 EL students and 14,233,565 total students enrolled. 


Source: 2013-14 National Center for Education Statistics (NCES) Common Core of Data (CCD) Local Education Agency Universe file. 


The sample consisted of 333 districts in each of the three strata. The use of strata with equal sample 
sizes is the most efficient design for making comparisons among the strata, helps to ensure that key 
subgroups are adequately represented in the sample, and improves the sampling precision for selected 
subgroup estimates. As a result, both high-EL districts and moderate-EL districts were oversampled 
relative to their frequency among all public school districts. For example, if all districts were sampled 
with equal probability, then only 57 high-EL districts would be selected, too small a number to provide 
reliable estimates and support comparisons with low-EL districts. 


Among the sampled districts, 28 were ineligible, leaving an effective sample of 971: three districts 
merged with other districts and were no longer independent entities, and 25 districts did not have EL 
students in the study year. A total of 767 districts provided valid responses, for a final response rate of 
79 percent. Response rates by strata were: high-EL districts, 81 percent; moderate-EL districts, 80 
percent; and low-EL districts, 76 percent. 


Teacher Sample 


The teacher sample included a probability sample and a supplemental sample of teachers who taught at 
least one EL student in the 2016-17 school year. The teachers of EL students in the sample included 
mainstream (general education) teachers and EL specialists. 


Mainstream teachers included general education teachers whose primary responsibility was instruction 
of students in a school’s main grade-level classroom or content area class that was not structured as 
solely focused on specialized instruction for EL students, and who instructed one or more EL students 
within that setting. Thus, mainstream teachers could include self-contained classroom teachers, or, ina 
departmentalized program, teachers of academic content classes designed for the general student 
population which also included EL students. 
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EL specialists included those who taught English as a Second Language (ESL), bilingual or dual language 
immersion programs, sheltered instructional classrooms, newcomer classes, or other specialized 
support for EL students. 


There was not always a clear distinction between mainstream teachers and EL specialists. Thirty-two 
percent of those teachers who were identified by their schools or districts as EL specialists described 
their own primary teaching responsibility as being a mainstream teacher. There was greater clarity in 
the other direction, with 99 percent of mainstream teachers describing themselves as having 
mainstream teaching as their primary responsibility. One possible explanation for these findings is that, 
in schools with small EL populations, teachers who were designated as EL specialists may still have spent 
most of their time teaching mainstream classes. Collectively, these EL specialists constituted only 

5 percent of all of those who identified themselves as mainstream teachers. However, statistics in this 
report for EL specialists actually include a substantial number who have multiple perspectives since they 
are not only EL specialists but also mainstream teachers. 


The initial probability sample for the teacher survey was drawn in three stages: 


e In the first stage, a subsample of 743 districts was randomly selected within strata from the 
999 districts selected for the district survey. Each sampled district was asked to provide a list of 
schools indicating the number of EL students for each school or indicating which schools 
enrolled one or more EL students. The study obtained a total of 537 lists of schools (174 from 
state databases) with EL-student enrollment data. 


e Inthe second stage, the grade level of the school to be sampled (elementary or secondary) 
was randomly determined, and then one school was randomly selected from the schools at 
that grade level that enrolled EL students, using a probability proportionate to size based on 
the number of students. Later in data collection, one school within each grade level was 
sampled. A total of 736 schools were selected and each selected school was asked to provide a 
list of teachers who taught one or more EL students. 


e =Inthe third stage, in each sampled school that provided the list of teachers (163 schools), 
between two and six teachers were randomly selected from the total number of EL teachers 
by teacher type. Initially, one mainstream teacher and one EL specialist were selected from 
each school that provided the teacher list. After difficulties arose in obtaining lists of teachers 
from schools, the number of teachers selected was increased to six per school (if six were 
available), ideally seeking an equal balance between mainstream teachers and EL specialists, 
but otherwise sampling all eligible teachers in the group with less than three, and all remaining 
teachers from the remaining group. A total of 593 teachers were selected in the third stage, 
and 332 (56 percent) of these sampled teachers completed the teacher survey. 


As noted above, the study faced difficulties in obtaining lists of teachers with non-response for many 
apparently due to school or district privacy concerns or policies against releasing names, or because the 
schools and/or districts had difficulty identifying which teachers had EL students in their classes. Given 
these difficulties and the short timeframe remaining for data collection, the study team modified the 
sampling protocol for the teacher survey in the following ways to create a supplemental sample. 


e = The principals of 492 schools that had not provided lists (and had not directly refused to 
participate) were asked to distribute teacher survey packets to up to six teachers of EL 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


students, including mainstream teachers and EL specialists where both instructed EL students 
in the school. 


e =6 A total of 2,952 teacher packets were sent to schools for potential teacher respondents. From 
this supplemental sample, 374 teachers from 127 schools provided responses. Following are 
the key differences between this supplemental sample and the original planned sample. 


a. The number of teachers to be selected (up to six) was more than originally planned, but 
consistent with the number used in later stages of data collection for the teachers selected 
in the probability sampling. 

b. Without having a teacher list from the school, the total number of eligible teachers at the 
school was unknown. This complicated both the weighting process and the calculation of 
response rates. That is, unless six responses were received from a school, it was not clear 
whether (1) the school did not have six teachers involved in teaching EL students, (2) the 
principals had failed to distribute all of the questionnaires even though a sufficient number 
of teachers were eligible, and/or (3) some teachers failed to respond after being given a 
questionnaire. 


c. The principal became responsible for the sampling, and may have chosen teachers using a 
nonrandom process that may have produced a different mix of teachers that might be 
biased in some ways. 


Taken together, there were a total of 717 survey responses received; 11 indicated that they no longer 
instructed EL students, leaving 706 respondents. The 706 eligible respondents constituted 59 percent of 
the 1,200 teachers that were the original goal for the teacher sample. Note that while the principal- 
selected sample constituted 53 percent of the respondents (unweighted), they formed 28 percent of the 
weighted number of teachers, lessening their impact on the overall results from what might be expected 
based on their unweighted numbers. Using weighted statistics, the principal-selected sample provided 
23 percent of the EL specialists and 26 percent of the mainstream teachers, along with some who were 
unidentified by teacher type, constituting 4 percent of the total weighted number of teachers. 


A later section of this appendix examines the implications of using the supplemental sample. However, 
to examine the implications it is best to use weighted data: One of the purposes of weighting is to adjust 
for differences in response rates (as well as differences in selection probabilities), and a key question is 
whether the weighting helped to adjust for any biases. Thus, this section first discusses the weighting of 
the sample. 


Weighting and Estimation 


The study produced district-level and teacher-level analysis and replicate weights. The analysis weights 
for the district survey data were created through a two-step process: creation of base weights and 
adjustments for nonresponse. Base weights were computed as the inverse of the probability of selection 
of the sample district within the stratum. These weights were adjusted to account for nonresponse that 
took into account the sampling stratum and census region. 


The general goal of the teacher weighting process was to mitigate sources of error from the survey, such 
as nonresponse. The teacher weights for the original sample were created sequentially based on the 
three stages of sample selection of the teacher sample, adjusted for nonresponse at the district, school, 
and teacher level. The district nonresponse adjusted weight was used as the initial weight for the school 
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weight. Separate school weights were then calculated based on the school type (i.e., elementary or 
secondary). Lastly, a teacher weight was created for all sampled teachers who completed the teacher 
survey, based on the selection of the type of teacher (i.e., mainstream teachers or EL specialists). 


As mentioned before, the teacher sampling protocol was modified to include a supplemental sample of 
teachers. In these schools, up to six teacher surveys could have been distributed and completed. For 
weighting purposes, it assumed that these teacher surveys were a simple random sample of the 
mainstream and EL specialists in the school. (This assumption is investigated later in this appendix.) The 
weights for mainstream teachers in these schools were created in a similar way as the weights for the 
mainstream teachers in the probability sample. However, for the supplemental sample, the actual 
number of eligible teachers and the number of surveys distributed to teachers were unknown, since the 
schools did not provide a list of teachers and the principals did not provide data on either the number of 
eligible teachers or the number of surveys they distributed. Thus, it was necessary to estimate the 
numbers for each school. The weights for the mainstream teachers in the supplemental sample were 
based on the estimated average number of mainstream teachers per school by sampling stratum and 
census region based on the probability sample, and the school nonresponse adjusted weight. Similarly, 
the EL specialist weight was computed based on the estimate of the average number of EL specialists 
per school by sampling stratum and census region based on the EL specialists in the probability sample. 


To properly reflect the complex features of the sample design, standard errors of the survey-based 
estimates were calculated using jackknife replication. Using the full sample weights and the replicate 
weights, estimates of any survey statistic and their standard errors could be calculated for the items 
from the district and teacher surveys. Weighted estimates from the district survey data are nationally 
representative. The next section discusses the degree to which the teacher data are nationally 
representative. 


Implications of the Use of a Supplemental Sample 


In order to get an acceptable number of responses and to include schools that refused to or were unable 
to provide teacher lists for sampling, for 492 schools the principals were asked to distribute teacher 
survey packets without directing the principals to specific teachers. Because the principals chose the 
teachers to be surveyed, it is possible that the principals intentionally or unintentionally created bias by 
selecting certain types of teachers more frequently than would be expected by chance.* Potential 
sources of bias include the following. 


e Picking teachers with positive experiences. When conducting evaluations, there is a potential 
that a school will want to create a positive impression, so that a principal might select 
teachers who would give the most favorable views. This was not an evaluation, and principals 
had no reason to expect rewards or punishments based on teachers’ responses. Still, it is 
worthwhile to look for signs of positive bias. 


The term “bias” is used here in a statistical sense, describing whether the teacher sample differed in systematic ways from a 
sample that would have been selected by chance. It is not meant to suggest that principals purposely selected some teachers 
in preference to others. 
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e Picking teachers who are tech-savvy. A principal might think the study would be aided by 
hearing from the teachers best qualified to discuss DLRs, or that tech-savvy teachers would be 
the most inclined to complete the surveys without complaint. Such a bias could result in over- 
reporting the level of use of DLRs, and under-reporting the burdens faced. 


e Picking teachers who are especially focused on EL students. Principals might think that 
teachers with a strong EL focus would be better qualified or more interested in completing 
the survey. Also, at a school where the data were not organized to easily identify which 
mainstream teachers had EL students, it may have been easier to select EL specialists or 
mainstream teachers with substantial numbers of EL students than to investigate who else 
might be involved. 


At the same time, some countervailing factors may help to limit the extent of bias. 


e Similarities among teachers at the same school. From a sampling perspective, it is better to 
select a small number of teachers per school across many schools than to select the same 
number of teachers at fewer schools: The data within individual schools are likely to be 
correlated, and the observations are not truly independent. For this reason, augmenting the 
sample by increasing the number of teachers per school (the number of mainstream teachers 
to be selected per school was increased during data collection from two teachers to up to six 
teachers) was not as helpful as it would have been to select more schools (which would have 
been impractical). However, when randomization of the sample is compromised, the 
correlations among teachers within a school may have some benefits: The presence of 
correlations among teachers at the same school may lessen the extent to which a different 
selection of teachers would produce different results. 


e Small number of eligible teachers. Particularly at small schools or schools with small EL 
student populations, there may be only one EL specialist and/or few mainstream teachers 
involved in teaching ELs. For such schools, there may be little or no difference between the 
sample that a principal produced and one that would be created through randomization. 
Indeed, among the 163 schools that provided teacher lists used for sampling, 16 had six 
eligible teachers or fewer. (Unfortunately, since no lists of eligible teachers were available for 
the schools where principals distributed surveys, there are no direct data on whether 
receiving a small number of teacher responses is a result of there being few eligible teachers, 
or whether there was a low response rate at those schools.) 


To determine whether and what kinds of biases might have been introduced by the addition of the 
supplemental sample, the teacher characteristics and patterns of responses were compared across both 
samples. It is the weighted statistics that are most important since (1) these are the statistics used in this 
report, and (2) it is only the weighted statistics that are designed to be nationally representative. Still, 
selected unweighted statistics are also provided in Exhibit A-2 to provide information about the degree 
to which weighting helped to overcome biases that otherwise might have appeared. Following is a 
summary of the results (Exhibit A-2). 
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Exhibit A-2. Comparison of original sample with supplemental sample in terms of district and teacher 
characteristics and behaviors 


Unweighted Weighted 
Original Original 

District or teacher characteristics sample Supplement sample Supplement 
EL student representation 

High-EL 29.8 35.8 41.9 39.6 

Moderate-EL 40.1 38.8 37.8 43.4 

Low-EL 30.1 25.4 20.3 17.1 
Teacher type 

Mainstream 58.1 70.6* 87.3 77.4 

EL 41.9 24.9* 12.7 9.9 

Unknown 0.0 4.5 0 12.7 
Primary teaching responsibility 

Mainstream, general education classroom 70.9 67.5 89.9 774* 

Bilingual or dual-language classroom 8.4 7.0 2.3 2.3 

Sheltered instruction program for ELs 2.7 2.4 1.2 6.3 

English as a second language (ESL) 10.8 14.2 3.7 6.0 

Other 6.7 8.9 3.3 8.5 
Subject area taught 

Language arts 56.3 65.5* 45.7 64.9* 

Math 46.7 63.1* 44.5 66.6* 

Science 42.2 55.6* 36.2 52.5 

Social studies/social science 41.3 57.8* 45.5 53.6 

ESL/English language 38.3 36.6 13.8 28.4* 
Level of comfort in using DLRs 

Not comfortable 10.3 10.8 9.0 8.3 

Somewhat comfortable 55.9 45.7* 45.5 48.6 

Very comfortable 33.8 43.5* 45.4 43.2 
Mean number of: 

DLRs used daily 2.7 1.9 

DLRs used daily or weekly 5.5 4.4 

Professional supports reported as extremely 

helpful 2.6 1.0 

Informal supports reported as extremely helpful 1.1 1.0 

Number of barriers to using DLRs to a large extent 2.3 2.7 

Number of positive outcomes that strongly agreed 

DLRs contributed to 3.6 2.0* 


Exhibit reads: In the unweighted data, high-EL districts represented 29.8 percent of the original sample and 
35.8 percent of the supplemental sample; in the weighted data, high-EL districts represented 41.9 percent of the 
original sample and 39.6 percent of the supplemental sample. 


* Statistically significant difference at 0.05 level between respondents to original sample and respondents to supplemental sample. 
Source: Responses to teacher survey items 2, 3, 14, 23, 31, 32, 35, and 36. 
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Teacher type. Unweighted, a greater proportion of teachers in the supplemental sample were 
mainstream teachers than in the probability sample (71 percent versus 58 percent). An 
overrepresentation of mainstream teachers could be predicted based on the sampling 
approach, since some schools in the original sample had only two teachers sampled (one 
mainstream teacher and one EL specialist), while the enlarged sample of six per school was 
more likely to over-represent mainstream teachers, given that mainstream teachers 
outnumber EL specialists. With weighting, the relationship was reversed and the difference 
was no longer statistically significant (87 percent were mainstream teachers in the original 
sample versus 77 percent that were mainstream teachers in the supplemental sample, with 
13 percent of the supplemental sample having an unknown teacher type), indicating that the 
weighting process compensated for the bias towards selecting mainstream teachers. 


Primary teaching responsibility (based on question 2 in the teacher questionnaire). Parallel 
to the results for teacher type, a greater proportion of respondents from the original sample 
were mainstream teachers (90 percent, weighted) than in the supplemental sample 

(77 percent), but unlike for teacher type this difference is statistically significant. One potential 
explanation for this difference is that, to the extent that it was difficult for schools to identify 
which teachers taught EL students, principals may often have turned to those teachers who 
were most easily identified as working with EL students, thus selecting EL specialists more 
often than might be expected. 


Subject areas taught. Weighted, teachers in the supplemental sample were more likely than 
those in the original sample to teach language arts (65 percent versus 46 percent), 
mathematics (67 percent versus 45 percent), and English as a second language or English 
language development (28 percent versus 14 percent). 


Factors showing no bias. No significant differences appeared between the original probability 
sample and the supplemental samples on the following factors: EL concentration in the 
district, the number of language groups among the EL students taught, the level of oral and 
literacy skills among the EL students taught, the certifications held, the highest degree held, 
whether the teacher was in the first year of teaching, the extent of use of the EL students’ 
language(s), the type of technology-related training received, the level of confidence in 
instructing EL students, the number of years of instructing EL students, the number of years of 
using DLRs, and whether they used DLRs in instructing EL students. 


Frequency of various practices and opinions. To a very slight extent, teachers in the original 
sample made more use of DLRs and expressed somewhat more positive opinions; however, 
the difference of opinions was only statistically significant for one measure: Teachers in the 
original sample strongly agreed that DLRs made a positive contribution on more outcomes 
than did teachers in the supplemental sample. 


In sum, across a wide variety of measures, the differences between teachers in the original sample and 
teachers in the supplemental sample were small and statistically insignificant. The significant differences 
that appeared were that teachers in the supplemental sample were somewhat less likely to be 
mainstream teachers, and strongly agreed on fewer items that DLRs helped contribute to positive 
outcomes. These two findings may be interrelated: Mainstream teachers identified somewhat more 
positive contributions to outcomes than did EL specialists (a mean of 3.4 versus a mean of 2.1), a finding 
much like that when comparing teachers in the original sample with those in the supplemental sample 
(3.6 versus 2.0). Thus, there may have been some tendency for principals to pick those teachers who 
were easiest to identify as teachers of ELs, creating a slight bias in that direction. For analyses that are 
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based on comparing mainstream teachers with EL specialists, the possible oversampling of EL specialists 
should not make any difference since the two groups are examined separately. When overall statistics 
are examined, to a small degree the results may over-represent the responses of EL specialists; on the 
other hand, the number of mainstream teachers so greatly exceeded the number of EL specialists 
(constituting 84 percent of the weighted total) that EL specialists had little influence on the overall 
Statistics. 


Thus, the use of a supplemental sample might have introduced a small bias toward oversampling EL 
specialists, but any impact on the findings seems likely to be minor. To be conservative, one should still 
view the teacher survey results as preliminary and as not having the same level of accuracy as the 
district survey, but there is no evidence of any serious bias having been introduced by the sampling 
approach. 


Analysis of Survey Data 


The survey data were weighted to adjust for the probability of selection and nonresponse. Unless 
specified otherwise, all statistics in this report are based on weighted data, and are based on the valid 
(i.e., nNon-missing) responses to each item. Statements of comparison (e.g., that mainstream teachers 
were more likely to give a certain response than EL specialists) are reported only if the difference was 
statistically significant at p<.05. The statistical tests used were either independent t-tests or, when the 
comparisons were not across independent groups, chi-square tests. Some exhibits present a large 
number of comparisons (up to 15), increasing the chance that a comparison might appear significant by 
chance. To adjust for the risk of multiple comparisons, Bonferroni corrections were applied. These 
adjustments are conservative depending on how one chooses to define the “family” of related 
comparisons. The corrections applied in the analysis considered all comparisons for an item (up to 15) as 
related comparisons, a conservative decision. The Bonferroni correction may sometimes be considered 
overly conservative; however, a limited test of an alternative approach, the Benjamini-Hochberg 
correction, produced similar results. 


To summarize the survey findings more compactly, and to better focus on the primary findings, this 
report sometimes uses composite variables that combine multiple responses into a single response 
(Exhibit A-3). These composite variables were created in two ways. 


e If the purpose of the composite variable was to measure whether something was provided 
and, say, three different items were combined, then a positive response to any of the three 
items was sufficient to record the broader category as receiving a positive response. The same 
code was given regardless of the number of positive responses. 


e If the purpose of the composite variable was to measure the frequency of use of a type of DLR, 
then the frequency of the most-used DLR type was recorded. For example, if any component 
received a response of weekly or daily, then the entire category is considered to have been 
used on a weekly or daily basis. This measure is conservative, only counting a DLR as having 
been frequently used if the responses definitively indicate it was frequently used. It is possible 
that if three different components were reported as used on roughly a monthly basis, then 
collectively they might have been used on a weekly basis. 
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e = The district and the teacher surveys included open-ended items on DLRs used and 
recommendations to improve the usefulness of DLRs for use in instructing EL students. The 
study team tallied the number of DLRs used. Responses that provided recommendations were 
reviewed to identify initial codes; researchers applied the initial codes, expanding and refining 
them through an iterative process. Paired researchers separately coded a subset of responses, 
met to discuss any differences in the codes and to reach consensus, and reviewed and finalized 
codes. As a final step, researchers summarized and reviewed the coded responses to identify 


key themes in district and teacher recommendations. 


Exhibit A-3. Composite variables used to summarize responses across multiple survey items 


Exhibits where 


Questionnaire Item Label Combined variable used 
District 9a/10a Tutorials on basic English language Language 11, 12, C-9 
9b/10b | Tutorials on language/literacy TUL Ona) si DIACEIcE 

9e/10e | Practice on language/literacy 
District 9c/10c Tutorials on math/science Academic 11, 12, C-9 
9d/10d Tutorials on social studies but oriais/ practice 
Of/10f Practice on math/science/social 
studies 
District 9g/10g Simulations or dynamic modeling tools | Simulations/virtual 11, 12, C-9 
9h/10h Virtual worlds to build academic skills wonds 
Teacher 23a Tutorials on basic English language Language 17, C-12 
23b Tutorials on language/literacy eo 
23d Practice on language/literacy 
Teacher 23c Tutorials on math/science/other Academic 17, C-12 
academic areas tutorials/practice 
23e Practice on math/science/other 
academic content 
Teacher 23f Simulations or dynamic modeling tools | Simulations/virtual 17, C-12 
23g Virtual worlds to build academic skills worlds 


Exhibit reads: District survey items 9a/10a (Tutorials on basic English language) 9b/10b (Tutorials on language and 
literacy), and 9e/10e (Practice on language and literacy) were combined to create the composite variable Language 
tutorials or practice, which is shown in Exhibits 11, 12, and C-9. 


Source: District survey items 9 and 10; teacher survey item 23. 
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Case Study Sample 


The research team identified a purposive sample of six school districts, including two districts from each 
EL-representation stratification category (high, moderate, and low). The process for identifying the case 
study districts and the key variables taken into consideration were: 


e Randomly selected 36 school districts from the subsample of districts selected for the first 
stage of the teacher survey, drawing 12 districts from each EL-student representation 
category. 


e —_ Identified 4-6 candidate districts in each district category based on general criteria such as 
locale and region. Additional districts were randomly drawn to expand the set of districts 
considered when the initial sets did not include the range of characteristics desired for the 
purposive sample. 


e Identified the final six case study districts to provide two districts from each of the three 
district categories of EL-student representation, while also purposively selecting to include a 
range of district characteristics. The final six districts varied in characteristics of the EL student 
population (home language and number of students) EL program types, urbanicity (based on 
the U.S. Department of Census geographic locale codes), geographic region, and districts with 
and without a stated technology plan. 


In each district, the site visit included two schools, one elementary and one secondary, for a total of 12 
schools across the six school districts. There were a total of 65 interviews conducted, including 17 with 
district administrators and 48 with school administrators and teachers. Thirty-two of the interviewed 
teachers provided a demonstration of a DLR they commonly used, and the project team conducted 18 
classroom observations. 


Analysis of Case Study Data 


Once each district visit was complete, the site visitors drafted district-level case study reports, which 
were based on data from the district interviews and two sets of school-level interviews, DLR 
demonstrations, observations, and relevant documents. All recorded interviews were transcribed and 
detailed notes were provided for interviews that were not transcribed. (Three interviews were not 
transcribed due to technical issues with the audio.)The transcriptions and notes were coded using 
qualitative analysis software (Dedoose). Researchers identified codes relevant for addressing each 
research question, and applied these initial codes. They expanded and refined these codes through an 
iterative process in which emerging themes were identified, and coding and analysis continued until no 
additional themes emerged. The researchers discussed key themes emerging within individual sites, and 
examined dimensions of similarity and variation across districts and across types of respondents. 
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Appendix B. 
District Contexts and Teacher Background 
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Districts: Total Student Population and EL Student Enrollment 


Districts in high-, moderate-, and low-EL categories varied in the size of the total student enrollments. 
Almost all (94 percent) low-EL districts reported total student enrollments of 5,000 or fewer. The 
majority of high-EL and moderate-EL districts had enrollments of over 5,000 (85 percent and 43 percent, 
respectively). 


Districts also reported on the number of EL students enrolled. 


Thirty percent of high-EL districts had total student enrollments of more than 20,000 students. 


100% 


0% 
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100% 
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15% 
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Source: District survey, item 1 (n = 269 high-EL districts, 265 moderate-EL districts, and 233 low-EL districts). 
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Almost all low-EL districts enrolled 100 or fewer EL students; however, about 8 percent included more 
than 100 EL students. 
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Source: District survey, item 3 (n = 261 high-EL districts, 261 moderate-EL districts, and 230 low-EL districts). 
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Districts: EL Student Population 


Almost all districts (96 percent) have enrolled EL students for more than five years, and more than three 
quarters (77 percent) reported offering English as a second language (ESL) instruction. 


Districts responded to various questions regarding their EL student population, including questions on 
the number of language groups represented in their district, the most common languages of their EL 
students, and the backgrounds of EL students they enrolled. 


Across districts, the most common language background of EL students was Spanish. 


More than 60 percent of high-EL districts reported having 10 or more language groups represented in 
their district. 


HIGH-EL MODERATE-EL LOW-EL 
100% 100% 100% 
66% 
52% 
46% 
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Source: District survey, item 4 (n = 263 high-EL districts, 261 moderate-EL districts, and 232 low-EL districts). 


Most high-EL districts reported having EL students that include refugees and other immigrants who 
arrived in the United States within the past five years. 


100% 
86% 
69% 
36% 
0% a 
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Source: District survey, item 6 (n = 263 high-EL districts, 262 moderate-EL districts, and 231 low-EL districts). 
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Teachers: Roles and Responsibilities 


Teachers provided information on their primary roles and the subject areas they taught. Data from the 
survey reveal that mainstream teachers and EL specialists differed in both their primary roles and the 
subject areas they taught. 


Mainstream teachers and EL specialists differed in terms of their primary roles. Almost all of the 
mainstream teachers taught a mainstream class, while the primary roles of EL specialists varied. 


MAINSTREAMTEACHERS _ ELSPECIALISTS 


Teach a mainstream class 23% 

Teach a bilingual class 0% 18% 
Teach sheltered instruction class for ELs 0% 8% 
Teach ESL as staff teacher 0% 33% 
Teach ESL as itinerant teacher 0% 10% 
Teach newcomer class 0% | 2% 
Co-teacher of general education class 0% 5% 
Other 1% | 1% 
100% 0% 100% 


Source: Teacher survey, item 2 (n = 456 mainstream teachers and 229 EL specialists). 


EL specialists more commonly reported that they taught language arts and English as a second 
language, while mainstream teachers more commonly reported teaching math and social studies or 
social science. 


sao pps EL SPECIALISTS 
Language arts 49% aaa 56% 
Math 53% |< nnnnns| 39% 
Science 43% oes | 33% 

Social studies/social science 52% ee | 31% 
English as a second language *11% ie 66% 

Other 31% 3x 

100% 0% 100% 


* Percentage for mainstream teachers is statistically different from percentage for EL specialists (p < .05). 
Notes: Percentages add to greater than 100 percent since teachers may teach more than one subject area. 
Source: Teacher survey, item 3 (n = 457 mainstream teachers and 232 EL specialists). 
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Teachers: Professional Certifications and Education 


We also asked teachers about their professional certifications and level of education. The survey data 
show that certifications for mainstream teachers and EL specialists differed. 


EL specialists were, as expected, much more likely to hold ESL certification and bilingual certifications 
than mainstream teachers. In contrast, EL specialists were less likely to hold grade level and subject 
area certifications. 


MAINSTREAM TEACHERS EL SPECIALISTS 


Grade level: 71% @ _ 
*Subject area: 64% @ | ee — 
') Grade level: 6 


') Subject area: 42% 


Bilingual: 24% 
*ESL: 19% @ . 


*Bilingual: 1% @ 


* Percentage for mainstream teachers is statistically different from percentage for EL specialists (p < .05). 
Notes: Percentages add to more than 100 percent since teachers may hold more than one type of certification. 
Source: Teacher survey, item 8 (n = 456 mainstream teachers and 231 EL specialists). 


The majority of mainstream teachers reported having a bachelor’s degree. The majority of EL 
specialists reported having completed a graduate degree — either a master’s degree or doctoral 
degree. 


MAINSTREAM TEACHERS EL SPECIALISTS 
Bachelor's degree:57% @ Graduate degree: 57% 
Graduate degree: 43% @ Bachelor's degree: 42% 


Source: Teacher survey, item 9 (n = 456 mainstream teachers and 231 EL specialists). 
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Teachers: Teaching Experience 


Both mainstream and EL specialists reported on their teaching experience and, more specifically, their 
experience in teaching EL students. EL specialists were more likely to have taught EL students for a 
greater number of years than mainstream teachers. 


Mainstream teachers and EL specialists reported smaller mean numbers of years teaching at the K-12 
level, at their current grade level, and in their district. 


MAINSTREAM 
TEACHERS 


EL SPECIALISTS 
At the K-12 level 


13 


13 


0 


At your current grade level 


In this district 


15 15 


Notes: Estimates are based on teachers who indicated 2016-17 was not their first year of teaching. None of the subgroup differences is 
statistically significant. 
Source: Teacher survey, item 11 (n = 407 mainstream teachers and 213 EL specialists). 


EL specialists reported more years of experience in instructing EL students than mainstream teachers. 
Nearly 70 percent reported having taught EL students for six or more years. 


MAINSTREAM 
TEACHERS 


One year teaching ELs 24% Cs 4% 
2-5 years teaching ELs 30% (ae 27% 
6-10 years teaching ELs 24% 21% 


11 0r more years teaching #958 | 9 
ELs Te | sas 


EL SPECIALISTS 


100% 0% 100% 


*Percentage for mainstream teachers is statistically different from percentage for EL specialists (jp < .05). 
Source: Teacher survey, item 17 (n = 454 mainstream teachers and 232 EL specialists). 
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Teachers: Number of EL Students and Confidence in Teaching EL 
Students 


Respondents to the teacher survey also reported on the number of EL students they taught, as well as 
their level of confidence in their ability to teach EL students. EL specialists reported teaching greater 
numbers of EL students than mainstream teachers, and had greater confidence in their ability to teach 
EL students. 


On average, EL specialists reported teaching 18 more EL students than mainstream teachers. 


MAINSTREAM EL SPECIALISTS 
TEACHERS 


Average number of 
EL students: 29 


1 

1 

1 

1 

! I 

! I 

I ! 

Median number of 

; EL students: 17 

*Average number of ¢ 
EL students: 11 ° 


I 
! 
1 
1 
1 
: 1 
*Median number of ® 1 
EL students: 4 © 
* Average or median for mainstream teachers is statistically different from values for EL specialists (p < .05). 
Source: Teacher survey, item 4 (n = 433 mainstream teachers and 229 EL specialists). 


EL specialists more frequently reported being very confident in their ability to instruct EL students 
than mainstream teachers; no EL specialists said they were not confident in their ability to teach 
EL students. 


MAINSTREAM EL SPECIALISTS 
TEACHERS 


I 
! 1 
Very confidentin 
» ability to teach EL 
*Very confidentin ability | students: 71% 
to teach EL students: 54% & 


Somewhat confidentin @ 
ability to teach EL students: Somewhat confident 
41% | in ability to teach EL 
students: 29% 
1 
1 


Not confident in 
ability toteach EL @ Not confident in 
students: 6% ability to teach EL 
students: 0% 


* Percentage for mainstream teachers is statistically different from percentage for EL specialists (p < .05). 
Source: Teacher survey, item 15 (n = 455 mainstream teachers and 230 EL specialists. 


22 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Teachers: Technology Training and Level of Comfort in Using DLRs 


Teachers reported on the type of training received in professional certification coursework related to 
the use of technology in instruction and on their comfort and experience in using DLRs in instruction. 
The types of trainings received, level of comfort with DLRs, and experience in using DLRs were similar for 
both mainstream teachers and EL specialists. 


Both mainstream teachers and EL specialists provided similar responses regarding coursework and 
training received on the use of technology in instruction. 


bicep EL SPECIALISTS 
None 0% 1 0% 
Discussed use of technology in some coursework 48% a | 46% 
Took course on integration of technology in instruction 62% | en 57% 
Did practicum on integrating technology in instruction 5% i 3% 
Other 6% ff 5% 
Not applicable 1% 5% 
100% 0% 100% 


Notes: Responses may total to more than 100 percent since teachers may receive more than one type of training. 
Source: Teacher survey, item 13 (n = 406 mainstream teachers and 206 EL specialists). 


Both mainstream teachers and EL specialists reported similar levels of comfort in using DLRs and the 
majority of both groups reported having used DLRs in instruction for more than one year. 


nipsbisbnt EL SPECIALISTS 
Not comfortable using DLRs 10% ie 6% 
Somewhat comfortable using DLRs 46% (i 54% 

Very comfortable using DLRs 45% Lay 40% 
Have not used DLRs 8% & 4% 
One year using DLRs 20% Ez 8% 

More than one year using DLRs 72% SEs 88% 
100% 0% 100% 


Source: Teacher survey, items 14 and 18 (n = 455 mainstream teachers and 231 EL specialists). 
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Exhibit C-1. Sources that teachers reported using sometimes or often to identify DLRs for instructing 
EL students, by first-year and experienced teachers 


99% 


My fellow teachers recommend * 
91% 


. 95% 
Administrators recommend 
86% 


; 83% 
Online searches 
72% 


_ 82% 
Technology coach or specialist recommends 
68% 


_ 82% 
School's EL specialist recommends 
64% 


77% 


Professional development on DLRs 
73% 


< oe 67% 
Students or their families recommend 
43% 


: 3 59% 
Searches of online DLR collections 
40% 


: : 59% 
Online teacher blog sites 
35% 


: : 55% 
Guidance from regional centers 
35% 
0% 20% 40% 60% 80% 100% 
Percent of Teachers 


@ First Year 
Experienced 


Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 99 percent of first-year teachers 
reported that they used the recommendations of their fellow teachers sometimes or often to identify DLRs for 
instructing EL students, compared with 91 percent of more experienced teachers. This difference is statistically 
significant. 

* Percentage for first-year teachers is statistically different from percentage for experienced teachers (p < .05). 


Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 25 (n = 32 first-year teachers and 528 experienced teachers). 
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Exhibit C-2. Criteria that districts reported were very important in selecting DLRs, in high-EL and low- 
EL districts 


Critiera Related to Capacity 


Can operate within the current district infrastructure 7 ie 


Has costs that can fit within our budget —— 


77% 
Is easy for teachers to use * 63% 


Has embedded professional development on its use * 46% 70% 


Critiera Related to General Education Use 


Provides English language and/or literacy skills instruction a 


Provides math, science, or social studies instruction 


Critiera Related to Use With EL Students 


Provides English language and/or literacy skills instruction 88% 


Was designed specifically for EL students * 


Provides math, science, or social studies instruction 


Other Criteria 

Is engaging and interesting for students 

Is aligned with our state standards * 

Has research evidence showing it is effective 
Is adaptive in design 


Is aligned with our curriculum 


Can be used by pairs or groups of students to collaborate Pr 


Operates within students' home internet capacity o giad 


0% 20% 40% 60% 80% 100% 
Percent of Districts 
@ High-EL districts 


® Low-EL districts 


Exhibit reads: Ninety-four percent of high-EL districts reported that whether the DLR can operate within the 
current district infrastructure is a very important criterion in selecting DLRs, compared with 87 percent of low-EL 
districts. This difference is not statistically significant. 


*Percentage for high-EL districts is statistically different from percentage for low-EL districts (p < .05). 
Source: District survey, item 12 (n = 261 high-EL districts and 227 low-EL districts). 
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Exhibit C-3. Support features that districts reported were very important in selecting DLRs for 
instructing EL students, in high-EL and low-EL districts 


F * 93% 
Visual supports 74% 
Various levels of text difficulty for the same content * 63% 84% 
A range of features to support EL students specifically * 57% 83% 
: * 76% 
Auditory supports 60% 
Definition functions using simple English 66% 
55% 
. — , : 63% 
Interactive dictionaries or glossaries 52% 
Materials in the languages of EL students * 59% 
39% 
; : 53% 
Translation function 49% 
; 49% 
Record and replay function 37% 
0% 20% 40% 60% 80% 100% 


Percent of Districts 


W@ High-EL districts 
™ Low-EL districts 


Exhibit reads: Ninety-three percent of high-EL districts reported that whether the DLR provides visual support 
features to explain or clarify the content and vocabulary is very important to them in selecting DLRs for use with EL 
students, compared with 74 percent of low-EL districts. This difference is statistically significant. 


*Percentage for high-EL districts is statistically different from percentage for low-EL districts (p < .05). 
Source: District survey, item 13 (n = 251 high-EL districts and 224 low-EL districts). 
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Exhibit C-4. Criteria that teachers reported were very important in selecting DLRs for instructing EL 
students, by first-year and experienced teachers 


Related to Student Use of DLRs 


Can be used by students with their parents or families * 507 92% 
Allows students to track their own progress a7 90% 
Promotes pairs or groups of students to collaborate 63% 85% 
Allows students to direct their learning * sane 85% 
Engages students in learning activities as a game aoee 61% 
Related to Content 
Is adaptive * —_ 
Is aligned with state standards * ao% 99% 
Various levels of text difficulty for the same content aaae 
Is aligned with our curriculum aoe 92% 
Related to Other Criteria 
Is easy for students to use Peg 
Has research evidence indicating its effectiveness 7% 91% 
Is easy for me to use sar 
Available through district or school on 84% 
Is very low cost or free 107 77% 
Other teachers have used successfully with students 53% 74% 
20% 60% 80% 100% 


Percent of Teachers 


@ First Year 
Experienced 


Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 92 percent of first-year teachers 
reported that whether the DLR can be used by students with their parents or families was very important to them 
in selecting DLRs for EL students, compared with 62 percent of more experienced teachers. This difference is 
statistically significant. 


* Percentage for first-year teachers is statistically different from percentage for experienced teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 26 (n = 34 first-year teachers and 526 experienced teachers). 
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Exhibit C-5. Support features that teachers reported were very important in selecting DLRs for 
instructing EL students, by type of teacher 


Visual supports 


Definition functions using simple English 


Translation function * 


Interactive dictionaries or glossaries 


Text-to-speech functions that let a student hear a text 


Materials in the language(s) of EL students 


Record and replay function * 


0% 20% 40% 60% 80% 100% 
Percent of Teachers 


@ Mainstream teachers 
EL specialists 


Exhibit reads: Among teachers who reported using DLRs in instructing EL students, 89 percent of mainstream 
teachers reported that whether the DLR includes visual supports is very important to them in selecting DLRs for EL 
students, compared with 88 percent of EL specialists. This difference is not statistically significant. 


*Percentage for mainstream teachers is statistically different from percentage for EL specialists (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 27 (n = 352 mainstream teachers and 205 EL specialists). 
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Exhibit C-6. Support features that teachers reported were very important in selecting DLRs for 
instructing EL students, in high-EL and low-EL districts 


Visual supports 


Definition functions using simple English 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 93 percent of teachers in high-EL 
districts reported that whether the DLR includes visual supports was very important to them in selecting DLRs for 
EL students, compared with 70 percent of teachers in low-EL districts. This district is not statistically significant. 


*Percentage for teachers in high-EL district is statistically different from percentage for low-EL district teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 27 (n = 194 high-EL district teachers and 144 low-EL district teachers). 
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Exhibit C-7. Support features that teachers reported were very important in selecting DLRs for 
instructing EL students, by elementary and secondary teachers 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 89 percent of elementary teachers 
reported that whether the DLR includes visual supports is very important to them in selecting DLRs for EL students, 
compared with 90 percent of secondary teachers. This difference is not statistically significant. 


* Percentage for elementary teachers is statistically different from percentage for secondary teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 27 (n = 365 elementary teachers and 209 secondary teachers). 
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Exhibit C-8. Support features that teachers reported were very important in selecting DLRs for 
instructing EL students, by first-year and experienced teachers 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 98 percent of first-year teachers 
reported that whether the DLR includes visual supports is very important to them in selecting DLRs for EL students, 
compared with 89 percent of more experienced teachers. This difference is statistically significant. 


* Percentage for first-year teachers is statistically different from percentage for experienced teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 27 (n = 34 first-year teachers and 540 experienced teachers). 
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Exhibit C-9. Percentage of districts reporting that they provided various types of DLRs for EL students, 
in high-EL and low-EL districts 
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Exhibit reads: Ninety-seven percent of high-EL districts reported providing language tutorials or practice DLRs for 
EL students, compared with 89 percent of low-EL districts. This difference is statistically significant. 


*Percentage for high-EL districts is statistically different from percentage for low-EL districts (p < .05). 
Source: District survey, item 10 (n = 259 high-EL districts and 231 low-EL districts). 
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Exhibit C-10. Percentage of teachers reporting that their EL students used DLRs weekly or daily, 
by type of student for whom the DLRs were designed, in high-EL and low-EL districts 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 79 percent of teachers in high-EL 
districts reported weekly or daily use of DLRs designed primarily for EL students, compared with 52 percent of 
teachers in low-EL districts. This difference is not statistically significant. 


*Percentage for teachers in high-EL districts is statistically different from percentage for low-EL district teachers (p < .05). 
Notes: Only those teachers who indicated in an earlier item that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 24 (n = 197 high-EL district teachers and 145 low-EL district teachers). 
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Exhibit C-11. Percentage of teachers reporting that their EL students used DLRs weekly or daily, by 
type of student for whom the DLR was primarily designed, by first-year and experienced 
teachers 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 85 percent of first-year teachers 
reported weekly or daily use of DLRs designed for English learner students when instructing EL students, compared 


with 65 percent of more experienced teachers. This difference is statistically significant. 


* Percentage is statistically different from percentage for experienced teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 24 (n = 33 first year teachers and 544 experienced teachers). 
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Exhibit C-12. Percentage of teachers reporting that they used DLRs weekly or daily, in high-EL and 


low-EL districts 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 77 percent of teachers in high-EL 
districts reported using language tutorials or practice DLRs weekly or daily, compared with 50 percent of teachers 
in low-EL districts. This difference is not statistically significant. 


*Percentage for teachers in high-EL districts is statistically different from percentage for teachers in low-EL districts (jp < .05). 
Notes: Only those teachers who indicated in an earlier item that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 23 (n = 198 teachers in high-EL districts and 143 teachers in low-EL districts). 
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Exhibit C-13. Percentage of teachers reporting various activity contexts in which their EL students 
used DLRs often, by type of teacher 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 63 percent of mainstream teachers 
as compared with 47 percent of EL specialists reported that, when EL students worked independently, they often 
used DLRs. This difference is not statistically significant. 

*Percentage of mainstream teachers is statistically different from percentage for EL specialists (p < .05). 


Notes: Only those teachers who indicated in an earlier item that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 30 (n = 355 mainstream teachers and 203 EL specialists). 
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Exhibit C-14. Percentage of districts reporting various indicators that they used to track the 
effectiveness of DLRs for EL students, in high-EL and low-EL districts 
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Exhibit reads: Sixty-nine percent of high-EL districts reported using performance on English proficiency tests as an 
indicator for tracking the effectiveness of DLRs for EL students, compared with 64 percent of low-EL districts. This 
difference is not statistically significant. 


*Percentage of high-EL districts is statistically different from percentage for low-EL districts (p < .05). 
Source: District survey, item 20 (n = 238 high-EL districts and 214 low-EL districts). 
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Exhibit C-15. Percentage of districts reporting that they provided professional development (PD) or 
support related to DLR use in instructing EL students specifically, and the persons 
providing the professional development, in high-EL and low-EL districts 
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Exhibit reads: Seventy-two percent of high-EL districts reported providing workshops on features of a specific DLR 
as professional development for instructing EL students specifically, compared with 36 percent of low-EL districts. 


This difference is statistically significant. 


*Percentage for high-EL districts is statistically different from percentage for low-EL districts (p < .05). 


Source: District survey, item 14 (n = 253 high-EL and 210 low-EL districts). 
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Exhibit C-16. Percentage of teachers reporting that they received various types of formal professional 
development on DLR use in general and on DLR use specific to EL students over a three- 
year period from 2014-15 to 2016-17, in high-EL and low-EL districts 
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Exhibit reads: Seventy-nine percent of teachers in high-EL districts reported receiving formal professional 
development related to DLR use in general through workshops on integrating DLRs into instruction, compared with 
43 percent of teachers in low-EL districts, over a three-year period from 2014-15 to 2016-17. This difference is 
statistically significant. 


* Percentage for teachers in high-EL districts is statistically different from percentage for teachers in low-EL districts (p < .05). 
Source: Teacher survey, item 35 (n = 226 teachers in high-EL districts and 190 teachers in low-EL districts). 
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Exhibit C-17. Percentage of districts reporting various barriers to DLR use in instructing EL students to 
some extent or to a large extent, in high-EL and low-EL districts 
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Exhibit reads: Seventy-seven percent of high-EL districts and 75 percent of low-EL districts reported that 
insufficient funding for purchases of DLRs was a barrier to DLR use for EL students to some extent or to a large 


extent. This difference is not statistically significant. 


* Percentage for high-EL districts is statistically different from percentage for low-EL districts (jp < .05). 
Source: District survey, item 15 (n = 253 high-EL districts and 222 low-EL districts). 
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Exhibit C-18. Percentage of teachers reporting various barriers to DLRs use for instructing EL 
students, to some extent or to a large extent, by first-year and experienced teachers 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 81 percent of first-year teachers 


reported that time to find DLRs was a barrier to some extent or to a large extent to their use of DLRs in instructing 
EL students, compared with 67 percent of experienced teachers. This difference is not statistically significant. 


* Percentage for first-year teachers is statistically different from percentage for experienced teachers (p < .05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 31 (n = 34 first year teachers and 540 experienced teachers). 
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Exhibit C-19. Percentage of teachers reporting various barriers to DLR use in instructing EL students, 
to some extent or to a large extent, in high-EL and low-EL districts 
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Exhibit reads: Of teachers who reported using DLRs in instructing EL students, 50 percent of teachers in high-EL 
districts reported that time to find DLRs was a barrier to some extent or to a large extent to DLR use in instructing 
EL students, compared with 88 percent of teachers in low-EL districts. This difference is statistically significant. 


* Percentage for teachers in high-EL districts is statistically different from percentage for teachers in low-EL districts (p <.05). 
Notes: Only those teachers who indicated that they used DLRs in instructing EL students responded to this item. 
Source: Teacher survey, item 31 (n = 195 teachers in high-EL districts and 144 teachers in low-EL districts). 
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Exhibit C-20. Percentage of teachers reporting areas in which they would appreciate more support 
related to DLR use with EL students, by type of teacher 
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Exhibit reads: Sixty-seven percent of mainstream teachers reported that they would appreciate more support in 
planning instruction that uses DLRs effectively with EL students, compared with 81 percent of EL specialists. This 


difference is not statistically significant. 


*Percentage for mainstream teachers is statistically different from percentage for EL specialists (p < .05). 
Source: Teacher survey, item 38 (n = 437 mainstream teachers and 226 EL specialists). 
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Exhibit C-21. Percentage of teachers reporting areas in which they would appreciate more support 
related to DLR use with EL students, by first-year and experienced teachers 
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Exhibit reads: Ninety-six percent of first-year teachers reported that they would appreciate more support in 


planning instruction that uses DLRs effectively, compared with 66 percent of experienced teachers. This difference 
is statistically significant. 


* Percentage for first-year teachers is statistically different from percentage for experienced teachers (p < .05). 
Source: Teacher survey, item 38 (n = 43 first year teachers and 636 experienced teachers). 
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**@"e. National Study of English Learners 


eo .* ma : 
“ir and Digital Learning Resources (NSELD) 


OMB 1875-0279 
District Survey 


District: State: 
Respondent’s Name: Title: 
Email: Phone: Date: 


NOTE: The primary respondent for this survey is the administrator or coordinator who is most knowledgeable 
about instruction received by English learner (EL) students in your district. Other district administrators or staff 
may assist as needed. 


PURPOSE OF THE SURVEY 

e The goal of this nationally representative survey is to inform the U.S. Department of Education on the use of 
Digital Learning Resources (DLRs) in the instruction of EL students. 

e Your responses will help to ensure that the findings accurately inform educators and decision-makers. 

e The findings will inform the development of a guide for educators in using DLRs to support EL students. 

e Districts in the study will receive an electronic copy by email upon its publication by the Department of Education. 


See instructions on the next page. 
Thank you for your assistance! 


CONFIDENTIALITY 

We will not present any personally identifiable information in any report or publication resulting from the study; we will not 
identify your school or district in any study report or publication; and no responses will be linked with any identifying 
information in any final data files created for the study. All responses will be aggregated and summarized across respondents. 
The study team will protect or maintain confidentiality of your responses except as may be required by law. No individuals 
other than research staff will see any individually identifying data (for example, names or addresses). Your participation is 
voluntary; however, your district’s participation is very important to providing policymakers with accurate and complete 
information. Data collection is being conducted in only a sample of districts throughout the nation. This greatly increases the 
importance of your response since it represents many other districts. 


If you have any questions about the study, please call 1-(855) 241-7535. If you have questions about your rights as a study 
participant, please call the Westat Human Subjects Protections office at 1-888-920-7631. Please leave a message with your full 
name, the name of the study (National Study of English Learners and Digital Learning Resources), and a phone number 
beginning with the area code. A research office staff person will return your call as soon as possible. 


According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such a 
collection displays a valid OMB control number. The valid OMB control number for this information collection is 1875-0279. The time 
required to complete this information collection is estimated to average 55 minutes per response, including the time to review 
instructions, search existing data resources, gather the data needed, and complete and review the information collection. If you have any 
comments concerning the accuracy of the time estimate or suggestions for improving the survey, please write: U.S. Department of 
Education, Washington D.C. 20202-4651. If you have comments or concerns regarding the contents or the status of your individual 
survey, write directly to: National Study of English Learners and Digital Learning Resources, Policy and Program Studies Service, Office of 
Planning, Evaluation and Policy Development, 400 Maryland Ave, SW, Washington DC 20202. 


IF YOU CANNOT ACCESS THE NSELD WEB IF YOU HAVE ANY QUESTIONS OR COMMENTS, 


SURVEY, PLEASE RETURN COMPLETED CONTACT: 
SURVEY TO: 


Mail: NSELD Study (8958.27.07) NSELD Helpdesk 
Westat Toll-free: 1-855-241-7535 
1600 Research Boulevard Email: NSELD@westat.com 
RB 3103F 
Rockville, MD 20850-3129 
1-800-254-0984 
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INSTRUCTIONS 


The focus of this survey is on use of DLRs in the instruction provided to EL students in your 
district. In responding: 


(1) Consider all instruction that your district provides to EL students, including instruction in 
general education classes as well as specialized instruction for ELs. 


(2) Respond based on the current 2016-17 school year, except where otherwise noted. 


(3) If you are the main respondent for the survey, please reach out to other district staff as 
needed to complete items. The online survey password can be shared, or you may use a 
paper copy to print out the survey for others to directly respond to items. 
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Definitions: Digital Learning Resources 


Digital Learning Resources (DLRs) refers to digital resources such as applications (apps), software, programs, or websites that engage students in learning activities and 
support students’ learning goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and digital communication tools. DLRs as defined 
here do not include the hardware or infrastructure needed to use the digital resources. 


DLR Category Definition Category Types and Examples 
Software, applications e Interactive tutorials or lessons (adaptive and other) such as an interactive lesson on life cycle of a butterfly or a math tutorial 
(apps), programs or on fractions. 
websites that offer e Practice and assessment tools such as a math app that provides multiple opportunities to practice addition skills. 
academic content Designed Learning ; : : ; ee F : , F 
resources and/or engage Activities e Dynamic modeling or simulation tools such as a physics simulation that lets students manipulate virtual equipment, change 
students in activities to parameters, and see the results. 
Digital learn academic content or e Virtual worlds that immerse a student in a fully interactive environment such as one that allows a student to roam in a period 
Academic skills, including but not of past history or explore a desert environment. 
ne limited to language and e Dictionaries, encyclopedias, e-books, topic blogs, and/or topic-focused websites that serve as information resources, such as 
literacy content or skills. References/ an online encyclopedia that offers students pictures, facts, and videos about mammals or a digital dictionary. 
Resources 
e Visual and auditory topic-related resources such as a YouTube video on earthquakes and plate tectonics. 
e Translation tools that assist students by providing a translation to another language; and 
Language Resource 4 5 . ; Pee 
Tools e Articulation tools that assist a student to accurate production of a language such as by showing images of how a sound should 
be produced and/or by letting a student record and listen to his/her own voice to compare with the model. 
Software, applications preccattibn Toole e Presentation/Publication Tools, such as slide presentation software, that allow students to communicate what they have 
(apps), programs or learned about a topic or to publish a digital story about a memorable day. These may include music, images, and/or video. 
websites that students use A ; ; ; ivities | r 
ane Word Processing Tools |° Word Processing software that allows students to write text to support their learning activities in a variety of ways. 
Digital organize, and analyze e Spreadsheet tools that allow students to organize and track information, such as entering and tracking local rainfall over time; 
Productivity |content. They do not e Data analysis and representation tools that allow students to analyze and represent information such as using a tool to 
Tools contain academic content. i = analyze and summarize the characteristics of selected Native American groups or tribes in the Southwest; 
nformation . . : : ; : 
Papen e Concept-mapping tools that let students visually represent relationships among sets of information, such as to create a 
Organization Tools . ‘ : on 
mindmap of the American Revolution or create a concept map for the causes of the Civil War; and/or 
e Story-templates that assist students to communicate a narrative using text and/or images, as in retelling a story they have 
heard. 
Software, applications e Discussion boards or forums where individuals can post reactions and/or comments to provide feedback and/or share 
(apps), programs or Asynchronous/ perspectives, such as where students write in-depth analysis of the novel they are reading and give feedback to their peers’ 
websites that students use Synchronous | analyses; and 
; Text Communications eames : one : 
to communicate, eEmails, text messaging, chats, for example, used as means of providing feedback to support student learning. 
ar collaborate, network, or 
Digital present information. They Reflection e Blogs or student journals allow students opportunities to share and/or reflect on their learning experiences, such as a student 
pone canon do not contain academic Tools who uses a journal entry to reflect on her understanding of particular math concepts. 
oois 


Integrated 
DLR 
Sets 


content. 


Videoconferencing/ 
Meeting Tools 


e Videoconferencing or meeting tools provide a remote means of seeing and speaking with others in real time, as where a 
science class sees and talks with NASA experts, or students in a Spanish dual language class see and share a geography game 
with Spanish-speaking peers in Mexico. 


Project Collaboration 
Tools 


Multiple individual DLRs can be combined in an Integrated DLR Set 


A structured combination of 


individual DLRs to provide a complete 


core or supplemental curriculum. 


Often, DLR sets are licensed 


package by a school district. 


Core Curriculum Integrated DLR Set 


e Document-sharing tools or other tools that provide an online platform where students can work on products together, as in 
cases where students have access to and jointly edit a shared book report. 


A math program for grades 6-8 that combines visual lessons with embedded 
assessments, productivity tools, and flexible class management tools into one package. 


asa 


National Study of English Learners and Digital Learning Resources (NSELD) 2018. 


Supplemental Integrated DLR Set 


A math intervention for at-risk students in grades 6-12 that provides tutorials, practice 
activities, and progress monitoring tools to inform instruction. 


yoday jeuly :ssausea7 Yysi|3uq 40} sadunosay Buiuseay jeusiq ynoge Aes suayseal 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


DEFINITIONS, continued 


English learner (EL) student refers to students who are individuals not born in the United States or whose native 
language is other than English and individuals who come from non-English-dominant environments whose skills in 
English are so limited that they derive little benefit from regular school instruction. “English learner” also refers to 
students who have no proficiency in English. Note: If your district has an operational definition for EL students, then 
use your district’s definition in responding. 


General education or mainstream instruction refers to instruction in grade-level classrooms or academic content 
area classes that is provided as the instruction for the school’s general student population, and that is not a 
classroom or class structured as English learner instructional services (see below). Note: General education 
classrooms or classes can include English learner students. 


English learner instructional services are instructional programs or services designed specifically to meet the 
needs of EL students in gaining proficiency in English and learning academic content. These include: 


e —_ Bilingual instruction: An educational program or instructional approach in which two languages, English and 
the students’ native language, are used to provide content instruction to classes of EL students. Bilingual 
programs may promote proficiency in both languages with the goal of students’ becoming fully bilingual, or 
the students’ native language is used initially to assist in students’ transition to all-English instruction and then 
decreased over time. 


e English as a Second Language (ESL) instruction: ESL programs (also English language development (ELD) or 
English for Speakers of Other Languages (ESOL)) provide instruction that focuses on the structure and use of 
the English language, using carefully articulated English language instruction designed to meet the needs of 
students at various levels of English proficiency. The instruction may use content materials related to the 
curriculum and typically involves little or no use of the native language. ESL instruction can be provided in 
scheduled class periods or as push-in instruction (the ESL instructor works with students within an ongoing 
content class) or as pull-out instruction (students move out of an ongoing class for an ESL session). 


e Instructional support by a paraprofessional: Paraprofessionals (also referred to as instructional aides or 
teachers’ aides) provide assistance to EL students in the classroom. They do not provide instruction, but 
provide additional support and help clarify material for students. Some are bilingual in English and the 
students’ native language and may provide translation or explanation in the native language. 


e Newcomer program: A specialized academic environment that serves newly arrived, immigrant EL students 
for a limited period of time. Newcomer programs typically focus on developing basic English language and 
literacy skills, instruction in core content, and acculturation to U.S. schooling. Students transition to a school’s 
regular language support program for EL after they have participated in the newcomer program. 


e Sheltered English content instruction: Sheltered instruction refers to regular grade-level instruction in core 
content areas that is provided in English through instructional strategies that make the academic content 
accessible to EL students while also assisting them to acquire academic English. 

e Two-way bilingual education or dual-language program: Also known as two-way immersion programs, two- 
way or dual language programs provide instruction using both English and a non-English language of the EL 
students to classes that include both EL and English-proficient students. The program goals are for all students 
to become bilingual and biliterate, to succeed academically, and to develop cross-cultural awareness. 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Background 
1. What is your school district’s total student population (grades pre-K—12) in this current school year? 
Number of students 


2. Inthe current school year, does your district enroll one or more students identified as an English 
learner (EL)? 


[ ] Yes (to item #3.) [_] No (Stop here and return the survey.) 


3. If yes, how many English learner (EL) students are enrolled in your district in grades K-12 in the 
current school year? (Note: If there are multiple student counts, use your October 2016 count or the count 
closest to that date.) 


Number of 
Grade EL students 
Pre-K 


Oo ON DU BPWNRP A 


12 
Ungraded 
Total 


4. How many language groups are represented among your English learner (EL) students? 


a. One language group only........ [= 
b. 2-5 language groups ..........00. [] 
c. 6-10 language groups............. [| 
d. 11-20 language groups........... [] 
e. 21ormore language groups... [_] 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


5. What is the most common language background among the English learner (EL) students in your 
district? (Check one box only.) 


[_] Spanish [-] Kurdish 

[_] Arabic [_] Russian 

[_] Chinese [-] Somali 

[_] Farsi [ ] Tagalog 

[_] Japanese [] Urdu 

[_] Korean [_] Vietnamese 

[_] Other language [_] No single most common language, but 
(Specify: ) two or more with about equal numbers 


(Specify: 


6. Which of the following describe the English learner (EL) student population in your district? (Check 
all that apply.) 


a. Our district has included EL students for more than five years..........::ccsceeeeeeees [| 
b. Our district began to enroll ELs only recently (within the last five years, including 
the current year). We did not have any EL students earli@r............ccccscccceesseeeeenees aa 
c. Our district ELs include refugees and other immigrants who recently arrived 
(within the last five years, including the current year) in the U.S..........::ccsscceesseeeeeeeees [ ] 
d. Within the last five years (including the current year), our district began enrolling 
ELs from a new language background(s) and culture(s) — different from those 
of ELs we have enrolled in the past............ccccccccccccsssessssececeescessessaeeeeeessessessaeeeeess 
e. Our district’s EL students include 25 percent or more long-term ELs, i.e., ELs 
who have received services for six years or more and remain as ELG.................+ 
f. Our district includes 25 percent or more ELs who have very limited, 
interrupted education or no prior formal CdUCAtION ..............ccscscceeecessessntseeeeeeens 
g. Our district’s EL students include 25 percent or more migrant students who 
are not present for the full SCHOO! YeaP. ...........csscceesecsscceessecseseecsseeeesseeeeeeesseecens 


h. Other (Specify; ) 


a a Fn 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Which of the following types of instructional services and/or programs does your district provide 
for English learner (EL) students? (Check all that apply.) 


a. Bilingual instruction for classes that include only EL students..............ee:cescceeceeeceeeeeeeeeeeee (3) 
b. Two-way bilingual or dual-language program for EL and English-proficient students ....... 
c. English as a second language (ESL) instruction ...........::cccsscceessecsssceesseceeseecssseecseeeseecssseeeens [| 
d. Sheltered English content instruction ..........ccccccccssssececsensececseneececeecaececseaaececseaeeeeseaaeeeeeeaaes [| 
e. Mainstream classroom instruction with instructional support by a paraprofessional ....... [| 
fe. SNEWCOMEr- CONTE Fai iiacctes cosdecevvenctectenatevcetagac Gen csaieccudesadessdusveceudasncGesissdeceedenadectessuecdedasaddeeesptes [| 
g. Other (Specify: ae || 


[See definitions.] Note: Relevant definitions will be provided for each item in the web survey; a 
definitions sheet will be included in the electronic copy of the survey. 


To what extent do you agree or disagree with the following statements as descriptions of your 
district’s approach to use of Digital Learning Resources (DLRs)? 


Strongly | Somewhat | Somewhat | Strongly 
District agree agree disagree disagree 


a. Use of DLRs is a high priority goal within our 
CUIStHIGN re reretescsatess eectesattenceass teaetssicauertsteaecrstesacs (a ie (| (el 


b. The district provides teachers with a wide range 
of DLRs to support instructiOn.............ccccecceeeeeeees 


c. The needs of EL students are taken into account 
when obtaining DLRs for use in this district. ......... 


d. There is support among district and school 
administrators for use of DLRs in instruction........ 


L) fee 


LJ L L 
L L @ 
LJ LJ LJ 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Does the district provide the following types of DLRs for the instruction of students in general 
education classes? |f so, please indicate for which students they are provided. (Check all that apply 
in each row.) 


For students jstudents in| For all 

identified jin selected) selected | students 
Categories and types of DLRs Not struggling| grade content in the 
(See Definitions.) provided | students levels areas district 


DIGITAL ACADEMIC CONTENT TOOLS 


a. Tutorials or lessons focused on basic 
English language skills and vocabulary ........ 


b. Tutorials or lessons focused on language 
ANA/or literacy .........ccccecsecesscecsseeeesseceseeeees 


c. Tutorials or lessons focused on 
mathematics OF SCIENCE oe. eeeeeeeeeeeeeees 


d. Tutorials or lessons focused on social 
studies/social SCICNCES...........ceseeeeeseeeceeeeecees 


e. Practice and assessment tools focused on 
language and/or literacy.........cccccesceeseeseeees 

f. Practice and assessment tools focused on 
math, science, or social studies/sciences.... 

g. Simulations or dynamic modeling tools. .... 


h. Virtual worlds to build academic skills or 
Content KNOWlEdBE ..........ccccccccecessssssteeeeeeeens 


i. Reference and resources (such as digital 
dictionaries, topic websites, visual and 
auditory resources, and other) .............cceeeeeeee 


j. Language translation tools ...........:cccccceeeees 
k. Language articulation tools .............:ccceeeees 
DIGITAL PRODUCTIVITY TOOLS 


I. Presentation tools .......cccccccccccsccsseeeeeeeeeseeeees 


m. Spreadsheets or data analysis tools 

n. Image or information organization tools 
(e.g., concept mapping, storytelling templates). 

DIGITAL COMMUNICATION TOOLS 


o. Discussion boards, blogs, chats, journals .... 


Pp. VIdEO-CONFEFENCING.........c.cccccccesesssstteeeeeeesees 


ae aus eee! hv lhe! he he 
a aus eee! hv! lhe! hee! he 
af aus eee! 6B lhe! hee he 
ae aus eee! hve! lhe! he he 
a eae eee! 6 lhe! hee he 


q. Project collaboration tools ...........ccssccceeeees 

INTEGRATED DLR SETS 

r. Structured sets of individual DLRs that 
provide full curricula (including learning 


activities, assessment, resources and student 
PrOgress MAaNaBeMENt) ...........cccsesseceeseseeceeeeees 


OTHER 


s. Other (Specify: ) | [a a [] 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


10. Does the district provide the following types of Digital Learning Resources (DLRs) for instructing 
English learner (EL) students specifically? \f so, please indicate for which EL students they are 
provided. (Check all that apply in each row.) 


For ELs in: 
Lowest | Selected | Selected 
Categories and types of DLRs Not proficiency, grade language | For all EL 
(See Definitions page.) provided levels levels groups | students 


DIGITAL ACADEMIC CONTENT TOOLS 


a. Tutorials or lessons focused on basic 
English language skills and vocabulary ........ 


b. Tutorials or lessons focused on language 
ANG HERA CY $s cs. oes. Bieta oieeectetiaetes 


c. Tutorials or lessons focused on 
mathematics Or SCIENCE .........:0:sccccccesesssrees 
d. Tutorials or lessons focused on social 
studies/social SCIENCES ........eeeeeeesesseneeceeeeeees 
e. Practice and assessment tools focused on 
language and/or literacy.........cccccsccesseeseeees 
f. Practice and assessment tools focused on 
math, science or social studies/sciences..... 
g. Simulations or dynamic modeling tools ..... 
h. Virtual worlds to build academic skills or 
Content KNOWlEdBE ..........:cccccccecessssssteeeeeeens 


i. Reference and resources (such as digital 
dictionaries, topic websites, visual and 
auditory resources, and other) .........:ssssccceeeeees 


j. Language translation tools ...........ccccccceceeees 
k. Language articulation tools .............:ccceeeees 
DIGITAL PRODUCTIVITY TOOLS 

lo [PRESIETTON WOLO)S coc coccnocaaoccceoqnocanoodbooccnodt 


m. Spreadsheets or data analysis tools 


n. Image or information organization tools 
(e.g., concept mapping, storytelling templates). 


DIGITAL COMMUNICATION TOOLS 
o. Discussion boards, blogs, chats, journals .... 


Pp. VIdEO-CONFEFENCING..........:cccccccccesssssstseeeeeens 


nt aa ei! hl lh he hme 
itl tiitt Hh Ef Ht 
it ttttt Hh EF Ht 
tt tninptt Hh Ek Ht 
tt eas ee) he lh) he he 


q. Project collaboration tools ............:::s:ccccceees 

INTEGRATED DLR SETS 

r. Structured sets of individual DLRs that 
provide full curricula (including learning 


activities, assessment, resources and student 
PrOgress MAaNageMEN) ..........ccccsessecccsseeceeeeees 


OTHER 
s. Other (Specify; _-—CC—ié*d« 


al 
LJ 
LJ 
LJ 
LJ 


LJ 
ie] 
i 
LJ 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


11. How does your district identify DLRs it provides for instructing students in general education 


classes and for English learner (EL) students specifically? (Check one in each row, for each of A and 


B.) 


Means of identification 


A. 


For students in general 
education classes 


B. 


For EL students 


specifically 


Used for identifying: 


Used for identifying: 


Some 
DLRs 


Most 
DLRs 


None 


Some 
DLRs 


Most 
DLRs 


a. Acommittee meets to review and select DLRs.... 


b. Adistrict administrator(s) identifies and selects 


c. School administrators identify and select DLRs... 


d. Classroom teachers request specific DLRs or 
types of DLRs from the district .............ccccccceeees 


e. EL-specialist teachers request specific DLRs or 
LY DES Of: DER ieee ee er escestes. Senet re rene teuaie Gen ren 


f. Other (Specify; Ci‘) 


L 


lino) 


L 


7 )6hClUC da he 


a 


LiL) 


L 


LiL) 


L 


Lil) a 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


12. What criteria does your district use to select Digital Learning Resources (DLRs)? (Check one in each 


row.) 
Not Somewhat Very 
Criteria important important important 
CRITERIA RELATED TO CAPACITY 
The DLR: 


BL [1S GEBW OP WEREINETS WO) WISE cocococsonosbosbonssonsssosuboascooosontooore 


b. Can operate within the current district infrastructure 
such as hardware and Internet capacity ............ccceeeeeees 


c. Has costs that can fit within our budget................:c00 


Lif 
Lif & 
7 


d. Has embedded professional development on its use..... 


CRITERIA RELATED TO GENERAL EDUCATION USE 


The DLR: 


e. Provides English language and/or literacy skills 
INSTRUCTION eccccerescerecerte terete eeccoee eee erenrtceeesstmeecsceseeses 


OO 
= 
OO 


f. Provides math, science, or social studies instruction...... 


CRITERIA RELATED TO USE WITH EL STUDENTS 
The DLR: 


g. Provides English language and/or literacy skills 
INSTRUCTION Eee eeeese cre asco tee eee accrue scene ee eet ne eee eee 


h. Provides math, science, or social studies instruction...... 


Ii 
DOU 
CJ 


i. Was designed specifically for EL students................0:06 


OTHER CRITERIA 


The DLR: 
j. Is aligned with our state standards............cccscccsssseeeeeenes 
k. Is aligned with our CUrriCUIUM ............cccceeeesssceeeeeeeseeseaees 


|. Can be used by pairs or groups of students to 
80} | Fel ofe tS cesecosecensacsacaocoshccusccacccuaccasceacacaene seca socscacresesedc 


m. Is adaptive in design (i.e., selects next material to meet 
studentis:skills level) .c...2sc cis eoec es ch hte iiens eleva eee ee 


n. Is engaging and interesting for students ...............:c0ee 


0. Operates within the Internet capacity available to 
StUCENTS at NOME 8. as cicoceasteett es etderraseeeie ins Setasente dl condos 


Has research evidence showing it is effective ................ 
Other (Specify: ) 


Liao aw eee 
Liao ew Bee 
Lao Bw eee 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


13. How important are the following features in your district’s process of selecting Digital Learning 
Resources (DLRs) for use with English learner (EL) students? (Check one in each row.) 


Not Somewhat Very 
Feature important | important | important 
The DLR: 
a. Includes materials in the languages of our EL students...... e& el el 


b. Has an auditory support (such as read-aloud English, Spanish, 
or other language) to support EL students’ comprehension 


ANA ParticiPAtiON 0... eeeccccssessecesseneceesececessenaeeeeestaeeeeeeaaes [| al [| 


c. Can provide visual support (such as images, graphics, virtual 
manipulatives, and illustrations) to explain or clarify the 
CONTEN ANA VOCADULALY .........eeeecceseectecessececeeseceeeeesececeeeeeaes 


Bi 
LJ 
LJ 


d. Includes a translation function that allows ELs to translate 
content into their own language from English or from 
their language to English ..........cccccccccccesssssssceeeeseessesssaeeeeees 


e. Has a record and replay function that allows students to 
record and hear their OWN VOICES.........:::ccccccceseessssseeeeeeesees 


f. Includes language-support features such as interactive 
dictionaries Or ZlOSSALICS. .........cccccccccessesssseceeeeecessesssteaeeeeeens 


g. Can provide a definition of a term or concept using simple 
English vocabulary and Structure. .........cccccssccccessseeeceesteeeeees 


h. Provides various levels of text difficulty for the same 
CONTENT eeecisstrd eeveiles eda dia ese eter hie chine 


i. Includes a range of features designed specifically to 
SUP DONE LSpracencnscshossetetecness cae aecarcen tees canoan amines taerecenencets 


j. Other (Specify; i) 
k. Other (Specify; i) 


It ft it tt 
it ft it 
iT ft it & 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


14. Inthe last three years (including the current school year), what kinds of professional development 
(PD) or support related to use of Digital Learning Resources (DLRs) has the district offered (1) for 
instructing students in general education classes, and (2) for instructing English learner (EL) 
students specifically? (Check all that apply in each column.) 


For instructing For instructing 
students in general EL students 
Type of professional development (PD) or support education classes specifically 


a. Workshop(s) on the components and features of a 


SPECITIC DUR ee etree Sees rar eee eee enone fal A 


b. Workshop(s) on integration of DLR(s) in instruction........ L] LJ 
c. One-on-one, in-classroom assistance in how to use a 


SPECITICIDUReererescees cetccee cece cee cere ro cre eee eee a [4 


d. Direct coaching support on designing lessons to 
integrate use of DLRs in a teacher’s own classroom 
IASEUG ON. a. 2ccecaveessecesccscnssuevssesobaedevesevvstegetatedteseceschitavtets 


Other Supports 


LJ 
LJ 


e. Access to online or web-based PD provided by the 
district on technology iNStrUCctiONn ..........::ccccssececeesteceeeeees 


f. Funding provided to teachers to attend conferences 
related to technology integration ..........c.cccccccssessesssteeeeees 


g. Release time for individual teacher planning related to 
technology-based reSOUICeS........cccssccccessteeeeeesteeeeeenteeeeees 


h. Specific time designated for teachers to confer with 
colleagues On USE Of DLRS .........ccccccccceeessesssteeeeeeesessesseaees 


i. Other (Specify:  —) 


Persons providing the PD or support 


j. DLR vendor representative............cccsscccccsssscecessectecessseeees 


k. External educational technology expert other than a 
VENCOF FEPFeSENtatiVE .........cccceeccesssecseseecseecesseeessseessseeees 


|. Internal district-designated educational technology 
COTO S) piece eerie cece eee eee PCR ae See OPEC ECR Iceee oro 


m. District PD administrator and/or coordinator .............60 
n. District instructional technology COaCHN............cccsccceeerees 


o. General education teachers lead workshops or guide 
OtheF-LeaChers west deeds cacetcevecelieseckevvitectieeectevihebtecny 


p. An EL-specialist teacher leads workshops or guides 
Otheniteachensecterccscccves-cccneccecsvess-cenrecscecnvea ceemveenecen teens 


q. Other (Specify;  —) 


fT PT Eiht fh 
la LU) i U6 he! he 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


15. To what extent do the following factors present barriers to use of Digital Learning Resources (DLRs) 
for English learner (EL) students specifically? (Check one in each row.) 


EL students specifically 


Not To some |Toa large 
Factor abarrier | extent extent 
RELATED TO CAPACITY 
a. Insufficient network speed and reliability ......... 0. es eeeeeeeeeeseeeeees ia ie (fal 
b. Insufficient funding for purchases of DLRs in general..............06 [| [| [| 
c. Insufficient technical support to troubleshoot hardware and 
SOLLW ANG ISSUCSremcoee-oeencsectenn sec ean ar ree trancvess cecrereorvteccercct creer = a el Fe 


RELATED TO IMPLEMENTATION 


d. Lack of funds to provide teacher training and professional 
development (PD) on integration of DLRs in general.................0 


e. Lack of technology coaches who can support teachers on 
integration Of DLRs in INStrUCtiON ............c:cccssceessecesscessteceesseeeeeees 


f. Amount of time required to set up and/or troubleshoot 


a 
LI 
Operation Of DLRs at SCHOOIS ..........cecssccccesssececeesteceeeeneeeeeesaeeeeeeaas [| 
LI 
LI 


g. Teachers’ level of technology Skills .............:scccesceceseeesseceeseeeeereees 


LU ee 
Lim ie 


h. Teachers’ need for expertise in instruction of EL students............ 
OTHER 


i. Difficulty in finding DLRs aligned with state and district 
Sta ane Secsecervarsceteetrscccr sacs tetes ascot tats Seeee nea oes Pa sceee sete ern Seen 


j. Lack of knowledge of range of available DLRS ..............ccccccceseeseees 


k. Lack of knowledge of range of available DLRs that are 
AaPPnoOphlate:fOmElsine.ensiset ees eee eat eee 


|. Lack of knowledge of how to select from the range of available 


m. Students’ lack of access to DLRs at home due to limited or no 
ales) dalshaters |o)= ellis seaceecntcencdnreroncencberacc varceuaneutrccd i ecoccenceeractnacceEence: 


n. Other (Specify; 
o. Other (Specify; sssss—issssSCi‘*d 


cf fF ff 
fT fF ff 


66 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


16. What are goals for the use of Digital Learning Resources (DLRs) for English learner (EL) students in 


this district? (Check one in each row.) 


Goals in use of DLRs 


A goal 


A major 
goal 


ACADEMIC CONTENT GOALS 

a. Build English listening and speaking skills ..............::cccceeeeee 
b. Build English literacy Skills ...........cccccsssscceecessesssteeeeeeseesees 
c. Learn new academic CONtEN ..........eeseeceeceeesteceeseeeeeeeeeeaees 
d. Practice academic content or SkilIS 0.0... eee eeeeeeeseeeeereeeeeees 


e. Build academic English proficiency.............:cccsccecssecessseeeesees 


LEARNING ACTIVITY GOALS 


f. Provide alternative means of understanding and 
COMIMUMICATINGE sere teeeweccesssevenceeceeecssecececoeeeceeeaes ceceoeececeeens 


Differentiate or individualize instruction .........c cece 


Promote student-to-student interaction and collaboration 
ABOUT CONTE Geese tesserae reece ee ene ene rete enes 


a le 


ae le le 


Sa le le 


STUDENT AFFECT GOALS 


i. Increase student motivation and positive attitudes for 
EET A Alla ee necreceeconrnco coc teonrccernas nce eoeeecceric acne rocneceer ec acne ropaeaee 


j. Increase student active engagement in content................. 


OTHER 


k. Support parent and family engagement .............::ccssceereees 


|. Encourage students to take responsibility for their own 
learning through student-driven work with DLRs............... 


MenBuildePasicenturnyskillseesmtse tee ere ere eee: 
n. Other (Specify: 


lao Ue 


Life Ue 


Law Ue 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


17. To what extent would you agree or disagree that use of Digital Learning Resources (DLRs) 
contributes to the following student outcomes for students in general education classes in your 
district? (Check one in each row.) 


NA - This 
is not 
Strongly |Somewhat| Somewhat | Strongly | relevant 
Use of DLRs contributes to agree agree disagree | disagree |to our use 


a. Improved academic achievement on 
English language arts ..........:eseeeerees [] fal [| EI (ial 


b. Improved academic achievement in 
math and/or SCICNCE..........ceceeseeeeeeeeeeee 


c. Improved academic achievement in 

cfovel Fl Pel aa elSieneacencoseenecencacencosesecenade 
d. Higher student attendance.................5 
e. Improved student positive attitudes 


LI 
[a 
LI 
toward learning and school.................. [ ] 
LJ 
LJ 
LI 


f. Increased student interaction and 
collaboration with peersS..............0008 


g. Enhanced parent and family 
engagement in student’s learning....... 


Li) | 
LL) I 
LS] | 
Oa 


h. Other (Specify: _ i) 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


18. To what extent would you agree or disagree that use of Digital Learning Resources (DLRs) 
contributes to the following student outcomes for English learner (EL) students specifically? 
(Check one in each row.) 


NA - This 
is not 
relevant 
Strongly |Somewhat | Somewhat | Strongly | to our 
Outcomes for DLR use with EL students agree agree disagree | disagree | DLR use 


a. Increased proficiency in English 
language and/or literacy skills.............. L is L LH 


EB 


b. Improved academic achievement ........ 


c. Improved academic achievement in 
math and/or SCICNCE........ccceecseeeeeseeees 


d. Improved academic achievement in 
SOCial StUCGIES...........cccscceseesteceeeeneeeeeenees 


e. Higher levels of active student 
participation in instructional activities.. 


f. Higher student attendance...............06 


g. Improved student positive attitudes 
toward learning and school .................. 


h. Increased student interaction and 
communication with peers...........ccce 


i. Enhanced parent and family 
engagement in student’s learning........ 


j. Increased student engagement in 
learning activities outside of school..... 


k. Other (Specify; = si) 


=) ] oo 2] ee) 
i] | oe L) ee) 
i) _] oo) ee) 
|] oo) eee) 
i) ] oo 2) ee) 
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19. In the current school year, to what extent do schools in your district have the following resources? 
(Check one in each row.) 


No Some Most All 
Type of resource schools schools | schools | schools 
a. One or more desktop computers for student use in 
EAChGlASSKOOMpesscssseterees erro eee 


LJ 
LJ 
zl 
3) 


b. Adesktop computer for the teacher’s use in every 
CIASSFOOM secessesetiesssegieshenedidsascdhceteedeicesesedecessarieesansiees 


d. Adocument camera or LCD digital projector for each 
CIASSFOOMIMN sss se.d cadcie ccdecetcsdcagiesesigchiceadagiteccdasesceatapees<casuics 


e. A tablet or laptop provided to teachers for their own 


f. Tablets, laptops, or other mobile devices on carts ...... 


g. One-to-one tablets or laptops available to students for 
WSECHIMISCHOO ee teree eres eevee sere reer eestor test meee ee 


h. One-to-one tablets or laptops provided to students for 
24/7 use, in School and at HOME... cceceeesseseesesseeeeseees 


i (Computer lab(s) eee eer eee renee 
j. Bring-your-own devices USEC. .......ccccccccesesssssseeeeeeesessees 
k. Staff to resolve computer hardware/software issues... 


|. Sufficient high-speed Internet capacity for many 
SimuUItaNeOUS DLR USEPS .........ceesceceseereeceseeeeecesseeeeeeseeeaeens 


m. Other (Specify; —i‘“‘CSCSCSsSCSCSC—=*™SYS 


1 SUB Be 
211 SUB Bei 
1 sua Be 
1 Sua ee el 
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20. Does your district track the following as indicators of effectiveness of Digital Learning Resources 
(DLRs) for students in general education classes? For English learner (EL) students specifically? 
(Check yes or no for students overall and for EL students specifically in each row.) 


Other (Specify: 


For DLR use For DLR use 
with students with 
in general EL students 
education specifically 
Measure Yes No Yes No 
a. Student performance on English language proficiency tests..... al Gl Eee 
b. Student grades on report Cards........ceecsceesceeeeeeeeseeeeesaeeeeeeeeeees [] [] [S| [ ] 
c. Student progression on reading book levels............:::scceeeeeeeeee | | ma (a 
d. Student scores on in-class ASSCESSMENHS.........eeeeeeeeteeeeseeeeeeeteees [] [] [| [| 
e. Student scores on district asseSSMENS ............ecceeeeeeeeeereeeeeeeee (a [] | [I 
f. Student scores on state ASSESSMENS......ccsscsseseseeeeteseeseseetessseeees ec: ear ily esl! = aE 
ge StuUdentAttendancere ere aioe oe eeten arteries fa le [ [| 
h. Student credits toward graduation earned ..........cccsccceesseeeeeeees [| [| [| [| 


21. What is the availability of onsite school technology support staff in your district? (Check one in each 
column. Provide your best estimate.) 


School level 


Our district 
has full-time 
tech support 
staff at each 

school 


1-4 schools 
share a full- 
time tech 
support staff 


5 or more 
schools share 
a full-time 
tech support 
staff 


No school- 
based tech 
support staff 


a. High school.......... 
b. Middle school 
c. Elementary school 


L 


L 
L 
il 


L 
LJ 
LJ 


Bo 
LJ 
@ 
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22. Please list up to two Digital Learning Resources (DLRs) that your district provides for use in 
instructing English learner (EL) students. 


a. DLRname: 
Source or publisher (if known): 


Purpose for use of this DLR in your district: 


b. DLRname: 
Source or publisher (if known): 


Purpose for use of this DLR in your district: 


23. If you could share your ideas about Digital Learning Resources (DLRs) with a DLR developer, what 
types of new DLRs or changes in DLRs would you suggest to help your district to more effectively 
instruct and support English learner (EL) students? (Provide your comments below.) 


Thank you! 
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**@°.. National Study of English Learners 


® . — : 
“i and Digital Learning Resources (NSELD) 


OMB 1875-0279 
Teacher Survey 


In case there are follow-up questions, please provide your contact information: 


Name: Title: 

School: District: State: 
Email: Phone: 

PURPOSE OF THE SURVEY 


e The goal of this nationally representative survey is to inform the U.S. Department of Education on the use of 
Digital Learning Resources (DLRs) in the instruction of English learner (EL) students. 

e The findings will be used to guide future educational research and policy. 

e Your responses will help to ensure that the findings accurately inform educators and decision-makers. 

e The survey findings will inform the development of a guide for educators in using DLRs to support EL students. 


See instructions on the next page. 
Thank you for your assistance! 


CONFIDENTIALITY 

We will not present any personally identifiable information in any report or publication resulting from the study; we will not 
identify you or your school or district in any study report or publication; and no responses will be linked with any identifying 
information in any data files created for the study. All responses will be aggregated and summarized across respondents. The 
study team will protect or maintain confidentiality of your responses except as may be required by law. No individuals other 
than research staff will see any individually identifying data (for example, names or addresses). Your participation is voluntary. 
However, your responses are needed to make the study comprehensive and accurate and to provide policymakers with 
accurate and complete information. Data collection is being conducted in only a sample of schools throughout the nation. This 
greatly increases the importance of your participation since your responses will represent many other similar teachers. 


If you have any questions about the study, please call 1-(855) 241-7535 or email NSELD-School@westat.com. If you have 
questions about your rights as a study participant, please call the Westat Human Subjects Protections office at 1-888-920-7631. 
Please leave a message with your full name, the name of the research study that you are calling about (National Study of 
English Learners and Digital Learning Resources), and a phone number beginning with the area code. A research office staff 
person will return your call as soon as possible. 


According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such a 
collection displays a valid OMB control number. The valid OMB control number for this information collection is 1875-0279. The time 
required to complete this information collection is estimated to average 35 minutes per response, including the time to review 
instructions, search existing data resources, gather the data needed, and complete and review the information collection. If you have any 
comments concerning the accuracy of the time estimate or suggestions for improving the survey, please write: U.S. Department of 
Education, Washington D.C. 20202-4651. If you have comments or concerns regarding the contents or the status of your individual survey, 
write directly to: National Study of English Learners and Digital Learning Resources, Policy and Program Studies Service, Office of Planning, 
Evaluation and Policy Development, 400 Maryland Ave, SW, Washington DC 20202. 


IF YOU CANNOT ACCESS THE NSELD WEB IF YOU HAVE ANY QUESTIONS OR COMMENTS, 


SURVEY, PLEASE RETURN COMPLETED CONTACT: 
SURVEY TO: 
Mail: NSELD Study (8958.27.07) NSELD Helpdesk 
Westat Toll-free: 1-855-241-7535 
1600 Research Boulevard Email: NSELD-School@westat.com 
RB 3103F 
Rockville, MD 20850-3129 
1-800-254-0984 
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INSTRUCTIONS 


The focus of this survey is on your use of DLRs in the instruction you provide to EL students. In 
responding: 


(1) Consider all instruction that you provide to your EL students, including instruction you 
provide as a mainstream teacher in a general education class that includes EL students 
and/or any specialized instruction for ELs that you may provide, as appropriate to your 


instructional responsibilities; and, 


(2)Respond based on the current 2016-17 school year, except where otherwise noted. 


Your survey responses will inform the educator guide to be developed in this study. An electronic 
copy of the guide will be sent to you and your school after its publication by U.S. Department of 
Education. 
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Definitions: Digital Learning Resources 


Digital Learning Resources (DLRs) refers to digital resources such as applications, software, programs, or websites that engage students in learning activities and support 
students’ learning goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and digital communication tools. DLRs as defined here do 
not include the hardware or infrastructure needed to use the digital resources. 


DLR Category Definition Category Types and Examples 
Software, applications, e Interactive tutorials or lessons (adaptive and other) such as an interactive lesson on life cycle of a butterfly or a math tutorial 
programs, or websites that on fractions. 
offer academic content e Practice and assessment tools such as a math program that provides multiple opportunities to practice addition skills. 
resources and/or engage Designed Learning - = 7 . - - - - : : 
students in activities to Activities e Dynamic modeling or simulation tools such as a physics simulation that lets students manipulate virtual equipment, change 
_ learn academic content or parameters, and see the results. 
Digital skills, including but not e Virtual worlds that immerse a student in a fully interactive environment such as one that allows a student to roam in a period 
Academic limited to language and of past history or explore a desert environment. 
i literacy content or skills. e Dictionaries, encyclopedias, e-books, topic blogs, and/or topic-focused websites that serve as information resources, such as 
References/ an online encyclopedia that offers students pictures, facts, and videos about mammals or a digital dictionary. 
Resources 
e Visual and auditory topic-related resources such as a YouTube video on earthquakes and plate tectonics. 
L R e Translation tools that assist students by providing a translation to another language; and 
anguage Resource . . ee 
. oF oe e Language articulation tools that assist a student to accurate production of a language such as by showing images of how a 
sound should be produced and/or by letting a student record and listen to his/her own voice to compare with the model. 
Software or online e Presentation/Publication Tools such as slide presentation software that allows students to create a series of slides to 
programs or websites that Presentation Tools communicate what they have learned about a topic; or to publish a digital story about a memorable day. Both may include 
students use to plan, music, images, and/or video. 
document, organize, and e Word Processing software that allows students to write text to support their learning activities in a variety of ways 
Word Processing Tools g pp g act y ys. 
jae analyze content. They do 
P poe it not contain academic e Spreadsheet tools that allow students to organize and track information, such as entering and tracking local rainfall over time; 
ee Y content. e Data analysis and representation tools that allow students to analyze and represent information such as using a tool to 
Inf = analyze and summarize the characteristics of selected Native American groups or tribes in the Southwest; 
nformation . : 3 : : . 
SS e Concept-mapping tools that let students visually represent relationships among sets of information, such as to create a 
Organization Tools : : : ae 
mindmap of the American Revolution or create a concept map for the causes of the Civil War; and/or 
e Story-templates that assist students to communicate a narrative using text and/or images, as in retelling a story they have 
heard. 
Software or online e Discussion boards or forums where individuals can post reactions and/or comments to provide feedback and/or share 
programs or websites that Sued iad perspectives, such as where students write in-depth analysis of the novel they are reading and give feedback to their peers’ 
students use to ; 
. llab Text Communications analyses; ang : ees : 
communicate, collaborate, eEmails, text messaging, chats, for example, used as means of providing feedback to support student learning. 
Se network, or present 
Digital ieietea The do not Reflection e Blogs or student journals allow students opportunities to share and/or reflect on their learning experiences, such as a student 
communrcgHon contain academic content. Tools who uses a journal entry to reflect on her understanding of particular math concepts. 
Tools 4 F e Videoconferencing or meeting tools provide a remote means of seeing and speaking with others in real time, as where a 
Videoconferencing/ : : ; : 
Meeting Tools science class sees and talks with NASA experts, or students in a Spanish dual language class see and share a geography game 
with Spanish-speaking peers in Mexico. 
Project Collaboration eDocument-sharing tools or other tools that provide an online platform where students can work on products together, as in 
Tools cases where students have access to and jointly edit a shared book report. 


Integrated 
DLR 
Sets 


Multiple individual DLRs can be combined in an Integrated DLR Set 


A structured combination of 


individual DLRs to provide a complete 


core or supplemental curriculum. 
Often, DLR sets are licensed as a 
package by a school district. 


Core Curriculum Integrated DLR Set 


¥ 


A math program for grades 6-8 that combines visual lessons with embedded 
assessments, productivity tools, and flexible class management tools into one package. 


National Study of English Learners and Digital Learning Resources (NSELD) 2018. 


Supplemental Integrated DLR Set 


A math intervention for at-risk students in grades 6-12 that provides tutorials, practice 
activities, and progress monitoring tools to inform instruction. 


yoday jeuly :ssausea7 Yysi|3uqy 40} sadunosay Buluseay jeusiq noge Aes suayseal 
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Supporting English Learners through Technology: What Districts and 
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DEFINITIONS, continued 


English learner (EL) student refers to students who are individuals not born in the United States or whose native 
language is other than English and individuals who come from non-English-dominant environments whose skills in 
English are so limited that they derive little benefit from regular school instruction. “English learner” also refers to 
students who have no proficiency in English. Note: If your district has an operational definition for EL students, then 
use your district’s definition in responding. 


General education or mainstream instruction refers to instruction in grade-level classrooms or academic content 
area classes that is provided as the instruction for the school’s general student population, and that is not a 
classroom or class structured as English learner instructional services (see below). Note: General education 
classrooms or classes can include English learner students. 


English learner instructional services are instructional programs or services designed specifically to meet the 
needs of EL students in gaining proficiency in English and learning academic content. These include: 


e —_ Bilingual instruction: An educational program or instructional approach in which two languages, English and 
the students’ native language, are used to provide content instruction to classes of EL students. Bilingual 
programs may promote proficiency in both languages with the goal of students’ becoming fully bilingual, or 
the students’ native language is used initially to assist in students’ transition to all-English instruction and then 
decreased over time. 


e English as a Second Language (ESL) instruction: ESL programs (also English language development (ELD) or 
English for Speakers of Other Languages (ESOL)) provide instruction that focuses on the structure and use of 
the English language, using carefully articulated English language instruction designed to meet the needs of 
students at various levels of English proficiency. The instruction may use content materials related to the 
curriculum and typically involves little or no use of the native language. ESL instruction can be provided in 
scheduled class periods or as push-in instruction (the ESL instructor works with students within an ongoing 
content class) or as pull-out instruction (students move out of an ongoing class for an ESL session). 


e Newcomer program: A specialized academic environment that serves newly arrived, immigrant EL students 
for a limited period of time. Newcomer programs typically focus on developing basic English language and 
literacy skills, instruction in core content, and acculturation to U.S. schooling. Students transition to a school’s 
regular language support program for EL after they have participated in the newcomer program. 


e Sheltered English content instruction: Sheltered instruction refers to regular grade-level instruction in core 
content areas that are provided in English through instructional strategies that make the academic content 
accessible to EL students while also assisting them to acquire academic English. 


e = Two-way bilingual education or dual-language program: Also known as two-way immersion programs, two- 
way or dual language programs provide instruction using both English and a non-English language to classes 
that include both EL and English-proficient students. The program goals are for all students to become bilingual 
and biliterate, to succeed academically, and to develop cross-cultural awareness. 
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Background 
1. Inthe current school year, do you instruct one or more English learner (EL) students? 


[ ]Yes [_] No (Stop here and skip to the end/return the survey.) 


2. Which of the following best describes your primary teaching responsibility in the current school 
year? (Check one only.) 

| teach a mainstream, general education classroom or content class................+ 

| teach a bilingual or dual-language classroom or content ClaSS ..........cceeeseeseseeees 


| teach a sheltered instruction program classroom or content class for ELs........ 


oO mo 


| teach English as a second language (ESL) as a staff teacher based in this 
school, providing push-in or pull-out instruction or ESL classes.............ccsssscceeeees 


e. |amanItinerant English as a second language (ESL) teacher who visits the 
school to provide ESL push-in or pull-out instruction or ESL classes ................65 


f. [teach a newcomer ClaSSrOOM OF ClASS.....ccccccsccccseeecccccececeeseeceeeeeeseeseeeueceeeseeeueaaes 


EM, IE, SET SINE TV) 


h. Other (Specify; ) 


3. What subject areas do you teach in the current school year? (Check all that apply.) 


Sol =[A (6 sieeartaneacanchty recor cnr cick Rocirronrncoche recon nr acocLt roman anrecocre racarenacuceeracantnrcoce rr 
Social Studies/SOCial SCICNCE.........ccccccceseseessccececececsessnncceceeccessensneseceeccecsesenteaeesevens 
English as a second language/English language developMent ............ssccssccseeeees 
Other (Specify: ) 


8 yo i 
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How many individual English learner (EL) students in this school do you teach in a typical week and 
in what grade levels? (Provide your best estimate by grade.) 
Number of 
Grade EL students 
PreK 


Oo ON DUH BPWN PA 


Ungraded 
Total 


About how many different language backgrounds are there among the English learner (EL) 
students you instruct in this school? (Check one only.) 


One language group only......... [] 
2-5 language groupS............05 
6-10 language groups............. 


21 or more language groups ... 


“mo ho @ 


L] 
LJ 
11-20 language groupS........... LC] 
[ea] 
L] 


I don’t KNOW uo... ecescese eens 
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6. What is the most common language background among the English learner (EL) students you teach 
this year? (Check one box only.) 


a. [_] Spanish i. L_] Somali 

b. [_] Arabic j. LJ] Tagalog 

C: | Chinese/Mandarin/Cantonese k. [| Urdu 

d. |] Farsi |. [_] Vietnamese 

e. [| Japanese m.[_ | Other language (Specify: ) 
f. [| Korean n. [| No single most common language 

g. [_] Kurdish o. [_] I don’t know 

h. [_] Russian 


7. What are the most common levels of oral English proficiency and English literacy skills among the 
English learner (EL) students you teach this year? Please provide your best estimate for each 


column. 
English oral English literacy 
proficiency skills 

EL student skill level (Check one) (Check one) 

ab HBERINNG: Ae Arce cre ceecerseen a nese tearm ects Sie eee Ne onecey a ial 

b. Advanced beginner..........cccscccccsssececsesseeecsesnececeeseeeeeeesneeeesees [| [| 

Cvs MINCERMECIAteeeccetecsecccd eerstrrevasscsstreoertoerasses terete actvees tesa [ ] [a 

d. Advanced intermediate ...........cceccccessssceceesseeeceeseeeeeesenaeens [| [| 

Cx PEIUCNtate sree tccecreticccesstieaem ss ieevere seme tieer eaten a ears saete [ ] al 

f. No most common level. My students differ widely ............. [ ] [ ] 
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What certifications do you hold? (Check all that apply.) 


as et Gradeslevel es seseran cere srecres sas ceete eee oes enemas [| 
Der “SUBject:are ae cicicecdlee leant eavedsdoveane cunt tetssessotndebactetees (| 
GAPE SEG ete Noth rete eee neat irate ute nena oee ae [| 
d.. Bilingual vs cit. cicccatieececisiecestsgsens cere tiaesees come uateeee [c3] 
e.. Special education’. os ivrcece reese secs eee [| 
f. — Education technology ...........cccccccccssssssscececesessessaeeeeees [] 
g. National Board Certification ............:cescceeceeeeseeeeeeees [| 
h. Other (Specify: )E] 
Ie) PENOSCEntifiCatlOnst cs.vvesscs- ses sssestee oe scoters eee [] 


What is your highest degree? (Check one.) 


ale SASSOCIALGIS Marsters ene ee eee ne orn eee [] 
Ds Bache lOres sess vctecesssiccedes oaceceRtinecs cs icecesscinevesteinevoesvizeees [E+] 
Ge MastersSarrccree esececceteee sree tee onc cnese eee seer eres [] 
d.... (Doctoral .sicctcicveanitvcticavetecteee haven lative teeeeedaih: [| 
e. No postsecondary degree..........cccssssscccccecsssesssseeeeeeees [] 


Is this your first year of teaching in grades K-12? 


[_] Yes (Skip to question #12) [_]No 


For how many years (including the current year) have you been teaching? (Provide your best 
estimate for each row.) 


due wAtsthexkKST2slevelie prerusctcsenantrecsetccseee teres years 
b. At your current grade level? ............ceeeeeeees years 
CA ulmathisidisthichtier scree eer cee years 


To what extent do you use your English learner (EL) students’ non-English language as part of your 
instruction? (Check one.) 


aw pNotiatiall Aa ras eee sere a eee eee [| 
b. Avery small amount (less than 2% of instruction)..... [] 
Ce SOMME (224.16) ere cece res ere sree [ ] 
d. Asignificant amount (25% Or MOF) .......cesceesseeeeeeees [] 


80 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


13. What training did you receive in your professional certification coursework related to the use of 
technology in instruction? (Check all that apply.) 


le DANKe) a Spaoeeranceoc nec cone arc oco Reon ascend RCC Ene Rac CeCe ore Ener ead ACEC nr CoC OCCEr ee ae CORREA el 
b. We discussed use of educational technology in some COUPSEWOFK .........:ccccccceeesesssneeees | 
c. | took a specific course on integration of technology in instrUCtiONn .............cscceesseceeeees [| 
d. |dida practicum that focused on integrating technology in instruction ............ccccee [ie] 
e. Other (Specify: il 
f. Not applicable — | have not taken professional certification CoUurSeWOFK...........ccceeeeees a 


14. How comfortable are you in using Digital Learning Resources (DLRs) in your instruction? (Check 


one.) 

aw (Noticomfortablew cscs secure ee rete [| 
b. Somewhat comfortable 0.0... ceeccceeseeeeeeeeseeeeneeetees [ ] 
es | Venyicomfontablense seer [| 


15. How confident are you in your ability to work with and instruct your current English learner (EL) 
students? (Check one.) 


a: Noticonfidentt nonce eee eae [| 
b. Somewhat confident... eecceesceceeeeeeeeeeeeseeseeeenees [ ] 
Gr Wenvyiconfident te cee ee ence er: [] 
16. Which of the following describe your perspectives on the value of use of technology in education? 

(Check all that apply.) 

Offers important tools for students to explore and learn new content and skills......... [] 
b. Offers important tools for students to practice and check their learning of 

already taught content and SKiIIS............cccscssssecececeseesssneeeceeecesseeeeeseeeessesseseeaeeeeeesseeeees [| 
c. Is primarily a distraction for students that disrupts learning .............cc:cccsscessseceesseesees [| 
d. Takes up too much of a teacher’s time in relation to any benefit ...............cccsccceceeeeeees [| 
e. ls an important resource for differentiating iNStrUCtiONn ............:cccsscceesseceeceessscessseeeseees [| 
f. | Requires too much class time for the amount of benefit to students ............eesseeeeees [| 
g. Is notvery useful for me in meeting the needs of my EL students .............::csscceesseeeeees [ie 
h. Is a useful resource for me in meeting the needs of my EL students..............ccccssseeeees [| 


81 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


17. How many years (include the current year) have you instructed one or more English learner (EL) 
students? (Check one.) 


a. One year —This is my first year teaching ELs.............. [| 
BE D5 VO AS. icone. coe sitsacaeaen decor saugn sevens ceeestedeth teudetes ateeeees [5] 
Ch) GRO Vearseeree cece ceceres cereree enero rere tener eereeee eee [| 
AG. 11 OF MOLE VEAL... eee eeeceesteceeeceeeeeeeesaeeteaaeeteeeeeeas [] 


18. For how many years in total (include the current year) have you used Digital Learning Resources 
(DLRs) in your instruction? (Check one.) 


a 
b. One year —|’m just beginning to use DLRs this year .. [] 


Ci TP DESIVOAMNS eeceseccrcs cence ve seeeeecc a ceete ce seeee rion seta neseeassoneseaeets [| 
Ce) G=1O VE AIS icc ele eke accede etal eects etree nasties [] 
Cae [ROMIMOKEGVEaNSeres ocr ecco ccceeeeteceo eecceeetese [rs] 


19. Do you use any Digital Learning Resources (DLRs) in instructing your English learner (EL) student(s) 
in this school year? (Refer to the definitions and the DLR category matrix.) 


[ ]Yes [_] No (Skip to question #34) 


20. What supports for use of Digital Learning Resources (DLRs) are available to you, and how available 
are they? (Check one in each row.) 


Rarely |Sometimes| Usually 
Not available | available | available 
available when when when 
Type of support tome needed needed needed 


a. Staff to resolve computer hardware or software 
ISSUCSarcrssecegrsteeser cess cests Secsat cree rests tte trteeceesencees crore, al fal [ ] (eal 


b. Staff to provide guidance on how to work with a 
SPECIFIC DLR cctecieceveresseternrcasteredeeetreaueesmavee aaeess 


[=] 
c. Staff to offer guidance on selecting DLRs for 
EL students in my ClaSSrOOM..........eeeceeeseeesteeeereeeees [E] il fa fi 
LJ 


d. Staff to provide one-on-one coaching on how to 
integrate DLRs in my instruction of all students...... 

e. Staff to provide one-on-one coaching on how to 
integrate DLRs in my instruction of EL students 
SPECITI Cally eevee steree Assen nts crease seer tered | ae oiemncee tn erey 


f. Informal support and guidance from other 
teachers in my school or district............cccccccssessseeees 


g. Guidance from regional support center or other 
regional technical assistance center staff................ 


h. Other (Specify; i) 


lia 
6h 6 
la 
la 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Categories of Digital Learning Resources (DLRs) Used 
(Refer to the DLR category matrix.) 


21. What types of Digital Academic Content tools do you use? Do you use these with English-proficient 
students in your class(es) only, English learner (EL) students only, or both English-proficient and EL 
students in your class(es)? (Check one in each row.) 


Categories and types of individual DLRs 


Used with/by 
Both 
English- 
Available | English proficient 
but | proficient EL and 
students | students EL 
these only only students 


DIGITAL ACADEMIC CONTENT TOOLS 


a. 


Tutorials or lessons on basic English 
vocabulary and language skills ..............:06 
Tutorials or lessons on language and/or 
IRF ACY ier Ait Seether endts eet asncets 
Tutorials or lessons on math, science, or 
other academic content areas...........:0cccee 
Practice and assessment tools for 
language and/or literacy..........ccccccssceeseeeees 
Practice and assessment tools for math, 
science, or other academic content areas... 


Simulations or dynamic modeling tools ...... 


Virtual worlds to build academic skills or 
CONTENT KNOWlEABE ..........:cccccccccsssessrtceeeeeess 
References and other resources provided 
specifically as K-12 learning resources 
(such as online dictionaries, topic websites, 
e-books, images ANd VidCOS)...1....csscccceestseeeeees 
Commercial and non-commercial websites 
or resources that were not designed as 
content for K-12 learning activities (such as 
travel sites, online store product display sites, 
ONAWVIDCOS) Nrcctereceesctenct terror encore eee 


Language translation tools ............cccccceeeeees 


Language articulation tools ...............:0000008 


i ft 


LJ 


| i ft 


LJ 


ff 


i ft 


LJ 


ff 


oe |e | a | 6h 
oe |e | a | he 


LJ 
= 


LJ 
LJ 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


22. What types of Digital Productivity and Digital Communication and/or other tools do you use in 
your instruction? Do you use these with English proficient students in your class(es) only, English 
learner (EL) students only, or both English-proficient and EL students in your class(es)? (Check one 
in each row.) 


Used with/by 
Both 
English- 
NA- English proficient 
Not Available | proficient EL and 
available | but not | students | students EL 
Types of DLRs to me used only only students 


DIGITAL PRODUCTIVITY TOOLS 
BL  PICSSEMIETTTONN WOLOIS ccnccoscscnsconscousconcccbeacsocenb0: i 
b. Spreadsheets or data analysis tools ........... fe] 


c. Information organization tools (such as 
concept maps and storytelling templates) ....... a 


DIGITAL COMMUNICATION TOOLS 


d. Discussion boards, blogs, chats, journals ... (taal 


e. Video-conferencing or meeting tools to 
communicate within our class or school... [_] 


Ut ale 
Um hale 
Ut Bale 
Um hale 


f. Video-conferencing or meeting tools to 
communicate with others outside of our 
GlasS;OMSCHOOlE ne sscccccescostesecoctecorusn seers (al 

g. Project collaboration tools for joint work 
within our class Or SCHOOI...........:ccsseceeeenees 


L 


h. Project collaboration tools for joint work 


OTHER 
ji. Other (Specify: ) a 
j. Other (Specify: ) L] 


Unt ia) & 
Un ia) & 
Un ta) & 
Lim aa he 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


23. What DLRs do you use in instructing your English learner (EL) student(s) and how frequently do you 
use these? Include general education instruction you may provide to a whole class that includes 
ELs). (Check one in each row.) 


Frequency of DLR use in instructing ELs 


Less than 
Type and/or content of DLRs Not at all | monthly | Monthly | Weekly Daily 


DIGITAL ACADEMIC CONTENT TOOLS 


a. Tutorials or lessons on basic English 
vocabulary and language skills .............. 
b. Tutorials or lessons on language 
ANA/or literacy .........cccecesceesseceeseeceseeees 
c. Tutorials or lessons on math, science, 
or other academic content areas .......... 
d. Practice and assessment tools for 
language and/or literacy..........ccccceceee 


[| ia | 
[| a | 
[| ia | 
[| oa | 
[| ia | 


e. Practice and assessment tools for 
math, science, or other academic 
CONTENT AKC aS coe ces coos ecco eee 


DIO 
DIO 
DIO 
DIO 
DIO 


f. Simulations or dynamic modeling tools 


g. Virtual worlds to build academic skills 
or content knowledge...........cccsceeeeeen 


al 
LJ 
LJ 
LJ 
a 


h. References and other resources 
provided specifically as K-12 learning 
resources (such as online dictionaries, 
topic websites, e-books, images, or videos). 


LJ 
LJ 
LJ 
LJ 
Sl 


i. Commercial and non-commercial 
websites or resources that were not 
designed as content for K-12 learning 
activities (such as travel sites, online store 
product display sites, videos, or other)........ 

j. Language translation tools ..............0068 

k. Language articulation tools ..............66. 

DIGITAL PRODUCTIVITY TOOLS 


|. Presentation tools .........c eee cccceeeeeeeee 


m. Spreadsheets or data analysis tools ...... 

n. Information organization tools (such as 
concept maps and storytelling templates) .. 

DIGITAL COMMUNICATION TOOLS 

o. Discussion boards, blogs, chats, 
JOUMN lS cceccoecrcc cee teece rc eenree 


ff Fi 
aS is fle 
| ft fh 
a iS fle 
aS iS a le 


p. Video-conferencing or meeting tools... 


=| |e 
a) |e 
| |e 
a | 
=) | 


q. Project collaboration tools ...............006 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


24. Considering all DLRs that your English learner (EL) student(s) use in the instruction you provide, 
how frequently are they using DLRs designed primarily for the following groups of students? (Check 


one in each row.) 


DLRs designed primarily for: 


Frequency of EL students’ use in instruction 


Less than 


Not at all monthly 


Monthly 


Weekly 


Daily 


General education stude 


a 
b. Struggling students ..........ceeessessseeeeees 


c. English learner students 
d. Other (Specify: 


INESPeve eee eeee ee 
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7 Ud 


7 Ul 


Lifes 


Lifes 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Identifying Digital Learning Resources (DLRs) 
25. Please indicate the sources you use, and how frequently you use each source, to identify Digital 
Learning Resources (DLRs) for instructing: 


e your students in general education class(es) (including whole-class or other instruction in which 
English learner students may participate), and 


e your EL student(s) 


(Check one in each of A and B, in each row.) 


** IF YOU TEACH ONLY EL STUDENTS, CHECK HERE: [ ] AND COMPLETE “B” ONLY ** 


Frequency used to identify DLRs 
A B 
For students in For 
general education classes EL students 
Not Not 
appli- Not at appli- Not at 
cable | allor | some- cable | allor | some- 
My sources for identifying DLRs are: tome | rarely | times | Often | tome | rarely | times | Often 


a. Recommendations of district or 
school administrators........cccceeeeeee [ ] [isi [] [ ] [is] [] [] Bl 


b. Recommendations of my fellow 
Weel nal eS iccaceecceeooscorscdenescecaosscesaaseecrbencee a 


c. Recommendations of the school’s 
EL Specialist... eeeeceesceceeceeeseeeeeeeees [ ] 


d. Recommendations of a technology 


LJ 
LJ 
POACIMOR SHEClalIstce a eae erence EJ (el 
EJ 
[2 


e. Recommendations from students 


or their families ..........cccccessesseceeseneeees | 
f. General online searches I’ve 
CONGUGLEC Meee eats csesceocestteceenceees: [ES] 


g. My searches of education-specific 
online DLR collections (e.g., 
Common Sense Media, EdSurge, 
OER COMMONS) .....eecceeceesteesteettetseeetaees [| 


h. Professional development sessions 
on DLRs provided in the district ......... [Ss] 


i. Guidance from regional service or 


L 
ig 
technical assistance centers............... 2] [he] 
i 
LJ 


j. Online teacher blog sites.................0 El 


k. Other (Specify; = ss —‘(C*dYSéC*CCS*~CYS; 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Selecting Digital Learning Resources (DLRs) 


26. How important are the following features and/or criteria when you are selecting Digital Learning 
Resources (DLRs) for: 
e your students in general education class(es) (including whole-class or other instruction in which 
English learner students may participate) and 
e your EL student(s). 


(Check one in each of A and B, in each row.) 


**IF YOU TEACH ONLY EL STUDENTS, CHECK HERE: |_| AND COMPLETE “B” ONLY ** 


A. B. 
For students in For 
general education classes EL students 
Features and criteria Not Somewhat Very Not Somewhat Very 
for selecting DLRs important | important | important | important | important | important 
FEATURES RELATED TO STUDENT USE OF DLRs 
The DLR: 


a. Allows students to track their 
OWN PSOGPeSS ......ccccessscessscesecesseeen: 


L 


b. Promotes pairs or groups of 
students to collaborate ..............65: 
c. Can be used by students working 
with their parents or families.......... 
d. Engages students in learning 
activities structured as a game....... 
e. Allows students to direct their 
learning, focusing on content 
they want to PUrsUe ...........eereee 


CONTENT FEATURES 
The DLR: 


f. Is aligned with state standards....... 
g. ls aligned with our curriculum........ 
h. Provides various levels of text 
difficulty for the same content....... 
i. Is adaptive (i.e., adjusts content 
to the student’s skill level or need). 


a UcukEchllhUrlhlcC<éi<iialhCUr 

li is oa] eae he 
lis oa) oe he 
lh i= aaa] Bal! & 
li aa] aa!) eB 
li i= ta] Beal! & 


OTHER CRITERIA 
The DLR: 


j. ls one that other teachers in my 
school have used successfully 
With Student .........:.cesceeeseeeetreeeeeee 


k. Is very low cost or free .........eeeeee 


I. Is one made available through my 
district Or SCHOO ............::ceeeceeereeee 


m. Has research evidence indicating 
its effectiveness ........ceeeeeeeeteeeen 


n. Is easy for ME tO USC........ceeeeeeeeees 
o. Is easy for students to USe............. 
p. Other (Specify: ) 


| | ee 
i | 
th 
i | ee 
| ee 
i | ee 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


27. How important are the following features when you select a Digital Learning Resource (DLR) for 
your English learner (EL) student(s)? (Check one in each row.) 


NA- I’m not 
aware of 
this feature Not Somewhat Very 
The DLR includes: or function | important | important | important 


a. Materials in the language(s) of my EL 
GlelU (of RES eescncorscceocccucocnesacadnencuenoseeasdasbeseuencnect [A] [| [ ] fe 
b. Text-to-speech functions that let a student 


hear a WOrd OF Phrase .......ccesessscecsssteeeeeeaaes [| [| im [| 


c. Visual supports for understanding such as 
images, illustrations, graphics, virtual 


manipulatives, and/or Vid€O ...........:ceceeeeees (al [Ee] [ f 


d. Atranslation function from English to other 
languages and/or from other languages to 


ENSLISH teiescaetiaveacebientactlevaesceedesiacsecvasdeasietact’s [| [| [| [| 


e. Arecord and replay function that allows 
students to record and review their own 


VOLCES Hyer os wcerrsuseeteroes deer seeeecvevececers semcereoee ial [| [ ] EI 


f. Language-support features such as 
interactive dictionaries, glossaries .............. [| [| [ei] [i=] 


g. Definition functions that explain a word or 
concept using simple English vocabulary and 


SEPUICHUIRe mt ere erent een eum eens | [fe] [ ] i 
h. Other (Specify: ) la L] L] 
i. Other (Specify: ) ey | L] 


89 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Technology Devices Used in Instruction 


We’d like to understand the digital devices that you use for working with Digital Learning Resources (DLRs) in your 
classroom in instructing your English learner (EL) students. Consider all instruction, including general education 
instruction in which EL students participate. 


28. Are the following hardware or devices available to you and how frequently do you use them in your 
instruction of English learner (EL) students? (Check one in each row.) 


NA Frequency of use in instructing ELs 
(not Less than 
aa z available : 
Digital devices to me) Not atall | monthly |Monthly| Weekly | Daily 


a. Aninteractive whiteboard in my 
GlassrOOnt test ere sen cre (ia fal ie (eal [] [a 


b. A document camera or LCD digital 
projector in my classroom.............05 


A computer lab in school................. 


d. Computers in the classroom that 


L 
LJ 
Students Share........eeeeseceeseeeeeneeeeeees [ ] 
a 
L 


e. Tablets, laptops, or other mobile 
CGeVICES ON A CAMt ....seeeceessceeeenteeeeeenes 

f. 1:1 tablets, laptops, or other mobile 
devices that stay in our classroom 
for StUdENtS’ USE .......eeceeeeseeceeseeeees 


U0 Baw) ee 
U0 Bow ee 
U0 Baw ee 
UU Baw Bu 


g. 1:1 tablets, laptops, or other mobile 
devices that students use both at 
school and at home.............:seeeeee 


LJ 
| 
LJ 
i) 
LJ 
LJ 


h. Students use their own mobile 
devices in the classroom. ............. 


i. Other (Specify: i”) 


Ey 
LIU 
i L] 
mL) 
a] 
LO 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Goals in Using Digital Learning Resources (DLRs) 


29. Which of the following are goals you have for use of Digital Learning Resources (DLRs) in instructing 
your English learner (EL) student(s)? (Check one in each row.) 


Extent to which this is a goal 
One of 
my goals, 
Not but nota A major 
Goals in use of DLRs with EL students a goal major goal goal 


ACADEMIC CONTENT GOALS 
a. Develop basic English language skills and/or vocabulary.... 


b. Build academic English listening and speaking skills ........... 
c. Build academic English literacy Skills .............cccsscceceesteeeeeees 


d. Learn new academic content in math, science, or social 
STUGIOS 225.004 bi toeccs Miss Bas nocd detavevacts oscasseabaciessiveviceiaeevids tosis 


e. Practice English listening and speaking skills................:000 


f. Practice English reading and writing SkillS..............ccccceeeees 


ia] a 
ia] ae 
ia] a 


g. Practice or review academic content or Skills ................000 


LEARNING ACTIVITY GOALS 


h. Provide students with alternative means of 
understanding and COMMUNICATING............ccccssececeesteceeeeeees 


i. Differentiate instruction for individual students............00.. 


j. Promote student-to-student collaboration in the class 
among ELs and their Peers .........::cccccssccccessseceeeesteeeeeeseeeeeens 


k. Encourage students to direct their own learning............... 


STUDENT AFFECT GOALS 
|. Increase student Motivation... eecccccccssseseeeeeesceseesseeeees 


Lif US 
Lif LBS 
Lie UBS 


m. Increase student active engagement in content.............6 


OTHER 


n. Support student work at home on learning activities with 
parents or family MEMbETS ...........cscccesseceesceestecessteeseseeesenees 


a 
L 
L 


o. Support student continued work on learning activities 
OUTSIDE OF ClASS seit csteccvessectaeeteecneselhe este cteiatien uateeciaele 


p. Other (Specify; i) 


| 
ft 
i 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Contexts for EL Students’ Use of Digital Learning Resources (DLRs) 


30. How frequently do your English learner (EL) student(s) work with Digital Learning Resources (DLRs) 
independently or in groups in your class(es) and/or in other contexts? (Check one in each row.) 


Extent that EL student(s) use DLRs 


Grouping structures for use of DLRs 


Not at all 


Rarely 


Sometimes 


Often 


All of their 
work on 
DLRs 


INDEPENDENT USE 


a. ELstudents work independently with a 


b. EL students work individually with a 
DLR, with a teacher or aide directly 


L 


FACilitating..iocetaget eos sileeeseeteSesateaet Note [] [ ] al [| 
GROUP USE 
c. Pairs or groups of EL students jointly use 

SUR Sheree ee eee ee eee eee OR [I] il [| [| zal 


d. Pairs or groups of EL students and 
English-proficient peers jointly use a 


e. ELstudents work as part of a whole 
classroom activity using a DLR(s)............... 


OTHER 


f. ELstudents are assigned to use a DLR to 
continue learning outside of class............. 

g. ELstudents are assigned to work with 
parents or other family members at 
home using a DLR(S) ..........c:ccsssscessseeeeseeeens 

h. EL students use DLRs during free time or 
after they finish assigned work ...............- 


i. Other (Specify: ) 


Le 


(IO 


LIU 


(IO 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


31. To what extent do the following factors present barriers to your use of Digital Learning Resources 
(DLRs) for instructing your English learner (EL) student(s)? (Check one in each row.) 


Extent this is a barrier to using 
DLRs for my EL students 


Nota To some Toa 
Factors that are barriers barrier extent large extent 


BARRIERS RELATED TO TIME 

EY “Uliagterwoy uilae! DIU; Saccecnceccorsaccrccrscecceasncoracasneccocconrcenancsdecote: el fl [ | 
b. Time to learn to USe DLRS 2.00... eee eesseceeseceeeeeceaeeeeaaeeeeeeeees [] [ ] [] 
c. Time to set up or trouble-shoot DLRs for use ...............4+ el [a] [] 
BARRIERS RELATED TO SUPPORT 


d. Lack of professional development on how to use 
SPECITIG DUR Siena sce aren eben ten err Senn arae re 


e. Lack of in-class support on using DLRs in instructing my 
SCUCENUS eeiivestei ced siceacesttesiesaheidecectitcideslavtcceusediles Uiececesneee 


f. Lack of principal’s support for use of DLRS..............::0000 
BARRIERS RELATED TO ACCESS 
g. Insufficient Internet Capacity...........cccccccsccsseessteeessseeeers 


h. Insufficient reliability of access to the Internet................ 


i. Very limited or no access to specific DLRs due to the 
limited number of licenses in the school or district......... 


j. District or school policy related to DLR Usé..............:00008 


k. Students’ lack of access to DLRs at home due to limited 
(OW? (ny WANWEXARVENY CY SY STR) scccnccsoccoccnoocneocyocnoccnocosocneuencocneodne 


|. Students’ lack of access at home for reasons other than 
limited or no Internet Capacity ...........cccccssssceceessesssssaeees 


OTHER BARRIERS 
IME COSES Of D RG rca cee ee eee 


n. Lack of language support in the DLRs in the language(s) 
Of My EL StUCENTS..........cccccccccecessessnsececeeeceesesseaeeeeeeeseeseaaees 


o. Difficulty in finding DLRs appropriate to my students’ 


Students’ low level of technology SkillS ............cccccecesseeeees 


q. My lack of knowledge of the available DLRs and how to 
CHOOSELAMONGALN EM waeetes sect -cscecesessceereceseetiestacsere es cceetee ss 


r. Other(Specify; i) 


awa] ee U awe a le 
7s oT ras hU6elUMlUrlhCU 
ltl a Ue a le 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Outcomes of DLR Use 


32. To what extent would you agree or disagree that use of Digital Learning Resources (DLRs) has 
contributed to the following types of outcomes for your English learner (EL) students? 


NA - 
Not 
Some- Some- relevant 
Outcomes for EL students Strongly | what what | Strongly | tomy 
agree agree disagree | disagree | DLR use 

a. Improved academic achievement................. [] iz [a iz [] 
b. Increased proficiency in English language ........ L] L] L] L] L] 
c. Increased English vocabulary.............cccsscceeeee el | al eI el 
d. Increased English literacy skills ..............:cccceesees [| [] [rs [ie] [] 
e. Higher levels of active student participation 

in instructional activities ....... eee [a] a Ea fal | 
f. Higher student attendance............cccccceesseeeeees [| [ ] (a) fie] [| 
g. Student progress in skill levels or academic 

contentslevelSze een coe coerce eee cece L] el ia fel [] 
h. Improved student positive attitudes toward 

learning aNd SCHOO) ...........cccssscceeesseeeessseeeesssees [| [a] a [| [] 
i. Increased student interaction and 

communication With Pee’ ...........:ecceeeceeereeeens [J a a il L] 
j. Enhanced parent and family engagement in 

Student’s learning ..........ccccsscccessseecesssseesesssseeees [fi L] bel LJ L] 
k. Other (Specify: ) LJ a I] LJ 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


33. Which of the following do you track to judge the effectiveness of Digital Learning Resources (DLRs) 
in supporting English learner (EL) students? (Check one in each row.) 


Measure 

a. 

b. 

G 

d. 

e. 

f. 

g. 

h. Other (Specify: 


EL student performance on English language proficiency tests 
EL student grades on report cards 
EL student progress on reading book levels 
EL student scores on in-class assessments 
EL student scores on district assessments 
EL student scores on state standardized assessments 


EL student progress on the DLR skills levels. ..........::cccessseccceenteceeseneeeceeneeeeeeenes 


) 


< 
n 


e 


a oe hUmh|lhU 


LI] ie) ey LI i = 


The next question asks about formal professional development (PD) that you received from your school 
or district during the past three school years (including the current year). Include workshops, institutes, 
consultations with coaches or other technology specialists and/or other PD on DLRs that you received 
through your school or district. 


34. What is your best estimate of the hours of formal professional development related to the use of 
Digital Learning Resources (DLRs) you have received in the past three school years (including this 
school year)? (Check one below.) 


None 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


In responding to the next two items, consider the professional development and other supports you 
have received over the past three years (including the current year). 


35. How helpful were the following formal professional development (PD) and other supports you have 
received in the past three years to your use of Digital Learning Resources (DLRs) in instructing your 


English learner (EL) student(s)? 


Professional development (PD) or support 
received in the past three years 


NA- 
Not received 


Extent helpful to 
my use of DLRs with my EL student(s) 


Not helpful 
at all 


Slightly 
helpful 


Moderately 


helpful 


Extremely 
helpful 


PD RELATED TO DLRs In GENERAL 


a. Workshops on how to select DLRs for 
my own students and instructional 


b. Workshops on how to work with the 
features of a specific DLR.............:.:cccccee 
c. Workshops on integrating DLRs into 
INStrUCtion iN BeNeral ...........secceceesseeeeeeees 
d. Coaching on selecting DLRs for my 
ClaSSFOOM INSTFUCTION.........cesseecessteeeeees 
e Coaching on how to integrate DLRs in 
my Classroom iNStrUCtiON............:eceeeeeees 
f. In-class assistance in how to use the 
feature of a specific DLR ..............:.:cccceees 
g. Individual release time for planning 
related to use Of DLRS............sccessseceereeees 
h. Specific joint time allocated for 
teachers to discuss use of DLRs ............. 
i. Online PD modules provided by my 
district to learn about DLRS ...............00 
PD SPECIFIC TO USE OF DLRs FOR ELs 


it kt ft tt 


it ft ft 


| fel | oe] | he 


| oe | oo] | hve 


iP kt ft tt 


j. Workshops on selecting DLRs 
specifically for my EL students.............. 
k. Workshops on integrating DLRs into 
my instruction for ELs ............::cseseeeeees 
|. Coaching on selecting DLRs for 
instructing my EL students.................05 
m. Coaching on how to integrate DLRs 
into instruction of my ELsS...............6. 
n. Scheduled consultations with an ESL 
or other EL-specialist teacher............ 


L] Bel) ee 


L] BL) 


L| Be] 


L] Be] 6 


L] Bel) ee 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


36. Considering the past three years (including the current school year), how helpful have the following 
types of informal professional development (PD) and other supports been to your use of Digital 
Learning Resources (DLRs) with English learner (EL) student(s)? 


Extent helpful to 
my use of DLRs with my EL student(s) 


Type of informal professional development NA- Not helpful] Slightly |/Moderately| Extremely 
(PD) and support Not received at all helpful helpful helpful 


a. Informal mentoring from or 
collaboration with another teacher... [| fal [El fal al 
b. Informal discussions as a group with 


other teachers or staff on using DLRs. [ ] [] [] lita] le il 


c. Learning on my own through online 
professional communities, discussion 
boards, and other collaborative sites.. (na im [i [| [| 


d. Learning about DLRs through online 
searchable DLR collections (e.g., 
Common Sense Media, EdSurge, OER 


COMMONS) exe kt edstoee teeta tet [| L | L] [cal [| 


e. Receiving support to attend a 
conference relevant to using DLRs 


With EL student ...........::s:cccccscsssessrseees (mal fel i el ze) 


f. Consulting with a school or district 
ESL or other EL-specialist teacher ....... [| 


g. Other (Specify: =i”) 


=) 
LO 
=) 
LO 
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Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


37. Do you provide any of the following types of professional development (PD) or support to other 
teachers in the current school year related to using Digital Learning Resources (DLRs) in instructing 


38. 


English learner (EL) student(s) specifically? 


Do you provide this 
PD or support? 


Type of professional development or support | provide in the current school year Yes 


No 


a. Informal mentoring of a classroom or content area teacher on DLR use for 


ol Eee Err ee eis Cee eeeee tT cree rere ere Tien eer er eee errr eee re re ereerriy crecereeceere ce erererterchTes 
c. Providing scheduled workshops on use of DLRs for EL students .................+ 


d. Providing suggestions of specific DLRs to a teacher for use with an EL 


LJ 
LJ 
a 
TAL [217 | ape Ate ere on ORT EO Ae CRON RN IC Ore rR A PESO OE ARLE Rn Ne [| 
al 
LJ 
fe) 


e. Holding regular, planned meetings with a teacher that include suggestions 
OMIDER FUSE; WiItIEE LES cet scseeeerer eres ce eee cree sre eee a amen ne se eee see 


f. In-class coaching of a teacher on using DLR(s) with EL students ................. 


g. Other (Specify; ) 


fT ff 


In which areas would you appreciate more support related to use of Digital Learning Resources 


(DLRs) with English learner (EL) students? (Check all that apply.) 


Understanding criteria to use in selecting DLRs appropriate for my EL students............... 
Planning instruction that uses DLRs effectively with EL students ...............cccsssccceceeeseesenees 
Managing instruction and learning as a facilitator of EL students’ work with DLRs............ 
Planning for effective mixed use of DLRs and non-digital reSOUrCes ...........cc:ssccccceeeseesentees 


Becoming informed about the range of DLRs available ..............c:cccsscceesseceereessneeessseessneeees 


amp oo of 


IN RetaY shoal al ic] ofa) =k apmerts gia IRSA oa nt Ria ae RD Rt RD a 
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39. Please list up to two Digital Learning Resources (DLRs) that you have used most frequently for 
instructing your English learner (EL) students: 


a. DLR#1 name: 
Source or publisher (if known): 


Please give an example of how you most typically use this DLR: 


b. DLR #2 name: 
Source or publisher (if known): 


Please give an example of how you most typically use this DLR: 


40. If you could share your ideas about Digital Learning Resources (DLRs) with a DLR developer, what 
types of new DLRs or changes in DLRs would you suggest to help you to more effectively instruct 
and support English learner (EL) students? 


Thank you for your support and contribution to this important study! 
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Teachers Say about Digital Learning Resources for English Learners 


OMB 1875-0279 
National Study of English Learners and Digital Learning Resources (NSELD) 


District Title II] Director or Coordinator for English Learner (EL) Services 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this district in instructing English learner, or EL, students. Please consider 
DLRs used in supporting EL students’ learning of both language and academic content. We are 
interested in all of the different settings in which EL students are instructed, including both mainstream 
or general education classrooms as well as the instructional settings where EL-specialist teachers work 
with EL students. We will also ask you some questions about general DLR use, so that we can 
understand the similarities and differences in the use of DLRs between in the EL and the general student 
populations. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 


DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 
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Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 


1. Tell us about your role and your responsibilities. 


a. 
b. 


Cc. 


d. 


e. 


f. 


How long have you been in your position? 
What is your background or experience in working with ELs? 


Do you provide professional development (PD) for teachers, either mainstream teachers, EL 
specialists, or both? //f yes] Please describe it. 


Does the PD that you provide address the use of DLRs? /If yes] Please describe it. 
Does the PD address the use of DLRs with ELs? /If yes] Please describe it. 


Do you assist the district in identifying DLRs for use with EL students? With non-EL students? 


2. Could you characterize the EL population in your district (e.g., size, language groups, whether they 
are newcomer ELs or a long-term EL population, special challenges)? 


a. 


Does your district use specific instructional programs or approaches to provide instruction to EL 
students in grades K-12 (e.g., mainstream, pull-out, push-in, dual immersion, newcomer 
program)? [If yes] Please describe it. 


3. Does the district have current or planned goals for using DRLs with ELs? For using DLRs with all 
students? [If yes] What are they? 


a. 


Does it have specific goals for using DLRs to engage families of ELs? [If yes] What are they? 


DLR Use with ELs 


4. Has the district identified any DLRs for teachers to use specifically with ELs? [If yes] Which DLRs 
have been identified? 


a. 


d. 


What purposes or goals do these DLRs address (e.g., specific content area learning, language 
development, social-emotional development)? 


In your view, what features or functions of these DLRs make them useful for ELs (e.g., read 
aloud functions, translation, first language support)? 


Are these DLRs intended for use with all ELs? Or are some DLRs specifically targeted to 
particular sub-groups of EL students? Are any of these DLRs also intended to be used with non- 
EL students as well? 


Are these DLRs intended to be used by mainstream teachers, EL specialist teachers, or both? 


5. Other than the DLRs purchased by the district, are you aware of other DLRs that schools or teachers 
use for supporting ELs? If so, what are they? 


Identifying, Selecting, and Purchasing DLRs 


6. Does the district have a specific process for identifying and selecting DLRs for use with ELs? [If yes] 
What is it? 


a. 


b. 


[If the district has a specific process for identifying and selecting DLRs for use with ELs] What 
characteristics, features, or functions does the district look for in choosing DLRs for EL students 
(e.g., practice, adaptive learning, translation, games or game-like elements, read-aloud)? 


To what extent is this process similar to or different from how DLRs for general use are 
selected? 
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Professional Development and Support around DLR Use with ELs 


7. 


9. 


Does the district provide any professional development (PD) to teachers that focuses on the use of 
DLRs with EL students? [If yes] Please describe it. 


[If the district provides PD to teachers focused on the use of DLRs with EL students, ask the following 
sub-questions; otherwise skip to the next question.] 


a. Who provides the PD? 
b. How frequently does the district offer this PD? 
c. What topics does the PD cover? 


d. Do mainstream teachers and EL specialist teachers receive different PD related to using DLRs 
with ELs? [If yes] Please describe any differences. 


Apart from PD, does the district offer supports to teachers who focus on DLR use for ELs 
[e.g., coaching, technical assistance, IT support, other resources, etc.]? 


a. Do mainstream teachers and EL-specialist teachers receive different supports related to using 
DLRs for instruction? [If yes] Please describe any differences. 


What additional PD or supports related to DLR use do you believe teachers of ELs need? 


Barriers Related to the Use of DLRs with EL Students 


10. Has the district encountered barriers that make it difficult for teachers to use DLRs with EL 


students? /If yes] Please describe these barriers. 


(E.g., Access to DLRs for EL students, access to PD around DLR use with EL students, difficulty in 
finding DLRs that EL students can use independently or that can challenge them appropriately, lack 
of alignment to ELs’ needs, structural factors such as itinerant EL teachers who do not have a 
homeroom, teacher attitudes, inadequate connectivity or hardware.) 


a. Has the district been able to address these barriers? [If yes] How has it done so? 


Evaluation of DLR Use 


11. How would you rate the success of DLRs being used in this district with ELs? 


a. What do you consider the indicators of successful use? 
b. What are the outcomes used to evaluate the use of DLRs with ELs? 


c. In your view, what are the features or components of these DLRs that have made them useful 
for EL students? 


12. Does your district have a process for evaluating the use of DLRs with ELs? /If yes] Please describe 


this process. 
a. To what extent are you involved in this process? 


b. How does this process inform or guide decision-making at the district about DLR use with ELs? 
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Gaps in DLRs 
13. How could DLR be designed or used to better support the specific learning needs of EL students? 


a. Are there any features or functions that you would like DLRs to include that would better 
support your ELs? 


14. Are there lessons you have learned from using DLRs with ELs or supporting teachers in their use 
that you can share with other district administrators? If so, what are they? 


This is the end of the interview. 
Do you have anything to add regarding DLR use in your district or DLR use related to EL students? 


Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 
National Study of English Learners and Digital Learning Resources (NSELD) 


District Technology Administrator 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this district in instructing English learner, or EL, students. Please consider 
DLRs used in supporting EL students’ learning of both language and academic content. We are 
interested in all of the different settings in which EL students are instructed, including both mainstream 
or general education classrooms as well as instructional settings where EL-specialist teachers work with 
EL students. We will also ask you some questions about general DLR use so that we can understand the 
similarities and differences in the use of DLRs in the ELs and the general student populations. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 
DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 


Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 
1. Tell us about your role and your responsibilities related to use of technology in the district. 


a. How long have you been in this position? 
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Has the district articulated goals related to use of technology for instruction? [If yes] What are 
they? 
a. Are there any specific technology goals related to ELs? 


b. Are any technology goals specifically related to how DLRs can be used to engage families? To 
engage the families of ELs specifically? If so, what are they? 


To what extent are DLRs used across schools for the instruction of students in general? For the 
instruction of EL students? 


Identifying, Selecting, Purchasing, and Using DLRs 


4. 


Does the district have a process for identifying and selecting the DLRs for instructional purposes? [If 
yes] Please describe it. 


a. Who is involved in the process? 


b. What characteristics, features, or functions does the district look for in choosing a DLR for 
instruction? 


c. Is there a separate process for identifying, selecting, or purchasing DLRs for ELs? [If yes] How 
does it differ from the general process? 


Has the district purchased or recommended any DLRs for use in schools? [If yes] Which DLRs have 
been selected? 


a. What purposes or goals do these DLRs address (e.g., specific content area learning, language 
development, social-emotional development)? 


b. Has the district purchased or recommended DLRs specifically for use with EL students? [If yes] 
Which DLRs have been selected? 


c. Are these DLRs intended to be used by mainstream teachers, EL-specialist teachers, or both? 


d. In your view, what are some of the features or functions of these DLRs that make them useful 
for ELs (e.g., read-aloud functions, translation, first language support)? 


e. Are these DLRs currently provided to all schools? [/f no] How did the district decide which 
schools received DLRs and select the specific DLRs they received? 


In addition to the DLRs purchased or recommended by the district, are you aware of other DLRs in 
use in schools by teachers or students? [If yes] What are they? 


a. Do you know if any of these are used to support the instruction of ELs? 


Does the district provide any devices to schools, teachers, and students for instructional purposes 
(e.g., 1:1 setting, laptop carts in a shared computer lab, the use of some other model)? 


Professional Development and Support for DLR Use with ELs 


8. 


Does the district provide or coordinate professional development (PD) or technical assistance for 
schools and teachers around the use of DLRs? [If yes] Please describe. 


a. Who provides the PD or support? 
b. How often is it provided? 
c. Are teachers required to participate in the PD? 


d. Does any of this PD or technical assistance focus on the use of DLRs to teach ELs? [If yes] Please 
describe. 
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10. 


Apart from professional development, what supports does the district offer to schools or teachers 
to facilitate the use of DLRs for instruction (e.g., coaching, technical assistance, IT support, 
resources)? 


a. Do any of these supports specifically apply to using DLRs to support the instruction of ELs? 


What additional PD or supports related to DLR use do you believe teachers need to use DLRs more 
effectively? More effectively with ELs? 


Barriers to DLR Use 


11. 


Has the district encountered barriers that make it difficult for teachers to use DLRs for instruction? 
[If yes] Please describe these barriers. 


(E.g., structural barriers, such as internet connectivity or availability of hardware, policy, teachers’ 
comfort with and motivation to use technology, availability of technology infrastructure or 
hardware, lack of technical support to promote effective use, concerns about student privacy.) 


a. Has the district been able to address any of these barriers? If so, what are some of the ways the 
barriers have been addressed? 


Evaluation of DLR Use 


12. 


13. 


How would you rate the success of DLR use in this district with students in general? With ELs in 
particular? 


a. What are the indicators of successful use? 


b. What features or functions of the DLRs have been found to be helpful for supporting students’ 
learning in general? Of ELs in particular? 


c. Have supports or structures contributed to or enhanced the successful use of DLRs? [If yes] 
What are they? 


Does your district have a process for evaluating the use of DLRs? [If yes] Please describe this 
process. 


a. To what extent are you involved in this process? 


b. What outcomes are used to evaluate the use of DLRs? Does the district use different or 
additional outcomes to evaluate the use of DLRs with ELs? //f yes] What are they? 


c. How does the evaluation process inform or guide decision-making at the district in regard to 
identifying, selecting, purchasing, or using DLRs? With ELs specifically? 


Gaps in DLRs 


14. 


How could DLRs be designed or used to support student learning needs better? Of EL students in 
particular? 


a. How could DLR features or functions be designed or used to better support the specific learning 
needs of EL students? 
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15. Are there lessons you have learned from using DLRs with students in general that you can share 
with technology specialists in other districts? Are there lessons you have learned about using DLRs 
with ELs in particular? 


This is the end of the interview. 
Do you have anything to add regarding DLR use in your district or DLR use related to EL students? 
Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 


District Director of Curriculum and Instruction 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this district in instructing English learner, or EL, students. Please consider 
DLRs used in supporting EL students’ learning of both language and academic content. We are 
interested in all of the different settings in which EL students are instructed, including both mainstream 
or general education classrooms as well as the instructional settings where EL-specialist teachers work 
with EL students. When answering questions, we would like you to think about how DLRs have been 
used for instruction with ELs in the current school year. We will also ask you some questions about 
general DLR use so that we can understand the similarities and differences in the use of DLRs in the EL 
and the general student populations. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewers: Hand interviewee the definitions sheet and briefly review the three categories of 


DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 
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Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 


1. Please describe your role and your responsibilities. 
a. How long have you been in your role? 
b. To what extent do you or your office support schools or teachers in using technology for 
instruction? 
2. Howdo you view the use of DLRs, or technology in general, for teaching and learning? 
3. Has the district articulated goals for the use of DLRs in instruction? [If yes] What are they? 
a. Are these goals the same for all students, including ELs? Or do goals regarding the use of DLRs 
differ for instructing EL students? 
b. Do any technology goals relate to how DLRs can be used to engage families? If so, what are 
they? Are these goals different for ELs and their families? 
DLR Use with ELs 
4. Has the district identified specific DLRs for teachers to use with ELs? /If yes] Which DLRs are these? 
a. What purposes or goals do these DLRs address (E.g., Student engagement, motivation, skills 
practice, content knowledge, family engagement, communication, language learning, literacy, 
content area learning)? 
b. What features or functions of these DLRs do you consider make them useful for ELs (e.g., read- 
aloud functions, translation, first language support)? 
c. Are these DLRs intended for use with all ELs? Or are some DLRs specifically targeted at 
particular subgroups of EL students? Are any of these DLRs also intended to be used with non- 
EL students? 
d. Are these DLRs intended to be used by mainstream teachers, EL specialist teachers, or both? 
5. Has the district identified any DLRs for teachers to use in general? [If yes] Which DLRs are they? 


a. 


What purposes or goals do those DLRs address (e.g., Student engagement, motivation, skills 
practice, content knowledge, family engagement, communication, language learning, literacy, 
content area learning)? 


Identifying, Selecting, and Purchasing DLRs 


6. 


Does the district have a specific process in place for identifying and selecting DLRs for use with ELs? 
[lf yes] Please describe the process. 


[lf the district has a process for identifying and selecting DLRs for use with ELs, proceed with the 
following questions; otherwise, skip to the next section.] 


a. 


In choosing DLRs for EL students, does the district look for specific characteristics, features, or 
functions (e.g., practice, adaptive learning, translation, games or game-like elements, read- 
aloud, first language support)? 


To what extent is this process similar or different from how DLRs for general use are selected? 
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Professional Development and Support around DLR Use with ELs 


7. 


10. 


Do you or your office provide professional development (PD) or support for teachers that focuses 
on DLR use? [If yes, proceed with the following questions; otherwise, skip to the next question.] 


Does the district provide PD that focuses on the use of DLRs with EL students? /If yes] Please 
describe that PD. 


a. Who provides the PD? 
b. How frequently does the district offer this PD to teachers? 
c. What topics does the PD cover? 


d. Do mainstream teachers and EL specialist teachers receive different PD related to using DLRs 
with ELs? [If yes] Please describe any differences. 


Apart from PD, does the district offer supports to teachers focused on the use of DLRs for ELs 
(e.g., coaching, technical assistance, IT support, other resources, etc.)? 


a. Do mainstream teachers and EL-specialist teachers receive different supports related to using 
DLRs for instruction? [If yes] Please describe any differences. 


What additional PD or supports related to DLR use do you believe teachers of ELs need? 


Barriers Related to the Use of DLRs with ELs 


11. 


12. 


In your view, has the district encountered barriers that make it difficult for teachers to use DLRs for 
all students? [If yes] Please describe these barriers. 


(E.g., teachers’ comfort with and motivation to use technology, availability of technology 
infrastructure or hardware, lack of technical support to promote effective use, concerns about 
student privacy.) 


a. Do financial or structural barriers, such as Internet connectivity or hardware availability, make 
using DLRs for instruction difficult? 


In your view, has the district encountered barriers that make it difficult for teachers to use DLRs 
with EL students? [If yes] Please describe these barriers. 


(E.g., access to DLRs for EL students, access to PD around DLR use with EL students, difficulty in 
finding DLRs that EL students can use independently or that can challenge them appropriately, lack 
of alignment with ELs’ needs, structural factors such as itinerant EL teachers who do not have a 
homeroom, thus making technology use difficult.) 


a. Has the district been able to address these barriers? [If yes] In what ways? 


Evaluation of DLR Use 


13. 


How would you rate the success of DLR use with ELs in your district? 


a. Can you provide examples of DLRs that are being used successfully with ELs in this district? 
What makes these DLRs successful? 


b. What outcomes do you use to evaluate the success of DLRs with ELs? 


c. In your view, what features or components of these DLRs have made them useful for EL 
students? 
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14. 


15. 


Can you provide examples of DLRs that are being used successfully with students in this district? [If 
yes] What are they? 


a. What makes these DLRs successful? 
b. What outcomes do you use to evaluate the success of DLRs? 


Does your district have a process for evaluating the use of DLRs with ELs? /If yes] Please describe 
this process. 


a. To what extent are you involved in this process? 


b. How does this process inform or guide decision-making at the district about DLR use with ELs? 


Gaps in DLRs 

16. Do you have suggestions for improved DLR design or use to support the learning needs of ELs [or 
students in general]? 

17. Do you have suggestions for how the district could better support teachers in using DLRs to instruct 
ELs [or students in general]? 

18. Are there lessons you have learned through your work using DLRs with ELs that you can share with 


other educators? [If yes] What are they? 


This is the end of the interview. 


Do you have anything to add regarding DLR use in your district or DLR use related to EL students? 


Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 


School Coordinator or Lead Teacher for English Learner (EL) Services 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, DLRs, are used in this school for instructing English learner, or EL, students. Please consider 
DLRs used in supporting EL students’ learning of both language and academic content. We are 
interested (1) in all of the different settings in which EL students are instructed, including both 
mainstream and general education classrooms; (2) in the instructional settings where EL-specialist 
teachers work with EL students; and (3) in the DLRs used for instruction with ELs in the current school 
year. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 
DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 

Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 


1. Tell us about your role and your responsibilities. 
a. How long have you been in this role at this school? 


b. How many years have you been an educator? 
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2. How long have you been working with ELs? 
a. To what extent do you feel prepared to work with ELs? 


3. What is the school’s EL population, and how would you describe it (e.g., size, language groups, 
whether they are newcomer ELs or a long-term EL population, special challenges)? 


a. Does your school provide instructional services for EL students? If so, what kinds of services are 
they (e.g., mainstream, pull-out, push-in, dual immersion, newcomer program)? 


4. Does the school have specific goals for using DLRs with ELs? [If yes] What are they? 


a. Does it have goals for using DLRs to engage the families of ELs? //f yes] What are they? 


Use of DLRs with ELs 


5. How widespread is DLR use in your school? What percentage of teachers at your school use DLR 
with ELs? 


6. Arethere particular DLRs commonly used with ELs at this school? [If yes] What are they? 


[lf the school has specific DLRs in use with ELs, continue with the following sub-questions; otherwise, 
please proceed to the next question.] 


a. Why has it chosen these DLRs? 


b. Are these DLRs intended for use by mainstream teachers, EL-specialist teachers, or both? [If 
intended for a particular type of teacher] Why? 


7. Dospecific features or functions of these DLRs make them especially useful to teachers working 
with ELs? [If yes] What are they (e.g., read-aloud functions, translation, first-language support)? 


8. Are DLRs used in specific programs for ELs, such as when EL students are “pulled out” of regular 
instruction? [If yes] Which DLRs are they? Why have these DLRs been chosen for use in specific 
programs? 


9. Are you aware of DLRs that mainstream teachers use with the general student population that they 
do not use with EL students? [If yes] Which ones are they? Are you aware of why they don’t use 
them with EL students? 


10. Does the school’s program of services for EL students use DLRs to support parent and family 
engagement? If so, how does it do so? 


Barriers Related to the Use of DLRs with ELs 


11. Do you know of barriers teachers encounter while using DLRs with EL students? [If yes] Can you 
provide specific examples? 


12. Are you aware of challenges that EL students face when using DLRs outside of the classroom? [If 
yes] Can you provide specific examples? 
Identifying, Selecting, and Purchasing DLRs 


13. Does the school have a specific process for identifying and selecting the DLRs that are used with 
ELs? [If yes] Please describe the process. 


[lf the school has a process for identifying and selecting DLRs for use with ELs, please proceed with 
the following sub-questions; otherwise skip to the next question.] 


a. Whois involved in the process? 


116 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


b. What characteristics, features, or functions does the school look for in choosing a DLR for ELs 
(e.g., practice, adaptive learning, translation, games or game-like elements, read-aloud)? 


Evaluating the Use of DLRs with ELs 


14. How would you rate the success of DLRs that the school is using with ELs? Can you name some 
examples of DLRs that are being successfully used with ELs? 


a. What outcomes or indicators does the school use to evaluate the success of these DLRs? 


b. Have particular features or components of these DLRs made them useful for EL students? [If 
yes] What are they? 


Professional Development and Support around DLR Use with ELs 


15. Does the school provide coaching, professional development (PD), or support for teachers that 
focuses on using DLRs with ELs? //f yes] Please describe these activities. 


[If the school provides coaching, PD, or support for teachers focused on DLR use with ELs, continue 
with the following sub-questions; otherwise, skip to the next question.] 


a. Who provides this PD or support? 
b. How frequently does the school offer PD or support? 
c. What support do you think is most useful to teachers? Please explain. 


d. Do the supports related to using DLRs for instruction differ for mainstream teachers and EL- 
specialist teachers? [If yes] Please describe any differences. 


e. Could additional PD or supports be offered to teachers to help them use these DLRs more 
effectively with ELs? //f yes] What do you suggest should be offered? 


16. Does the school have systems or structures in place to facilitate collaboration between EL- 
specialists and mainstream teachers concerning the use of DLRs (e.g., during grade-level 
team/PLC/COP meeting)? [If yes] Please describe them. 


Gaps in DLRs 
17. How could DLRs be designed or used to support the specific learning needs of EL students better? 


a. Are there any features or functions that you would like DLRs to include that would better 
support your ELs? 


18. Are there lessons you have learned about using DLRs with ELs that you can share with other 
educators? [If yes] What are they? 


This is the end of the interview. 
Do you have anything to add regarding DLR use related to ELs or students in general? 
Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 
School Principal 


Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, DLRs, are used in this school for instructing English learner, or EL, students. Please consider 
DLRs used in supporting EL students’ learning of both language and academic content. We are 
interested in all of the different settings in which EL students are instructed, including both mainstream 
or general education classrooms as well as the instructional settings where EL-specialist teachers work 
with EL students. When answering questions, we would like you to think about how DLRs have been 
used for instruction with ELs in the current school year. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 
DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 


Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 


1. Tell us about your position and experience. 


a. How long have you been principal at this school? 
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2. Please describe the EL population in this school (e.g., size, language groups, whether they are 
newcomer ELs or a long-term EL population, special challenges). 


a. Does your school provide services for EL students? [If yes] What services are provided 
(e.g., mainstream, ESL pull-out or push-in, dual immersion, newcomer program)? 


b. From your perspective, how prepared are your teachers and staff in general to work with EL 
students? 


3. What are your expectations for how teachers should use DLRs for instruction at your school? 


a. Do you have different expectations for how teachers should use DLRs to teach ELs versus 
teaching students in general? 


b. Has the school set goals related to how DLRs can be used to engage the families of ELs? [If yes] 
What are they? 


4. Howdo you view the use of DLRs for instruction? 


Use of DLRs 


5. Onthe basis of your classroom observations, what proportion of your teachers use DLRs for 
instruction? [If any teachers use DLRs, proceed with the following questions; otherwise, skip to the 
next question.] 


a. Are there specific DLRs that most of the teachers use? [If yes] Which ones are they? 


b. Do teachers use some DLRs with their non-EL students that they do not typically use or that 
they use differently with their EL students (or vice versa)? If so, why? 


6. Does your school or district require teachers to use specific DLRs as part of their instruction? [If yes] 
Which ones are they? How have teachers reacted to this requirement? 


a. Are there any that the school or the district encourages teachers to use? [If yes] Which ones 
are they? 


Barriers Related to the Use of DLRs with ELs 


7. Is the school equipped to support the use of DLRs in classroom instruction (e.g., computers for 
students, internet connectivity)? 


8. Does your school face barriers that affect the use of DLRs for teaching and learning? 


a. Do different or additional barriers affect DLR use with EL students? Can you provide a specific 
example of what you view as a barrier related to using DLRs with EL students? 


9. Are you aware of challenges that EL students face when using DLRs outside of the classroom? [/f 
yes] Could you provide specific examples? 


Identifying, Selecting, and Purchasing DLRs 
10. Does your school use a specific process for identifying and selecting DLRs? [If yes] Please describe it. 


[If the school has a process for identifying and selecting DLRs, proceed with the following questions; 
otherwise, skip to the next section.] 


a. Who is involved in the process? 


b. What characteristics, features, or functions does the school look for when choosing DLRs? 
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11. Does your process for identifying, selecting, or purchasing DLRs for EL students differ from your 


general process for purchasing DLRs? [If yes] Please describe this process. 


a. What characteristics, features, or functions do you look for in choosing DLRs for EL students 
(e.g., practice, adaptive learning, translation, games or game-like elements, read-aloud)? 


Evaluating the Use of DLRs with ELs 


12. How would you rate the success of DLR use in your school for the instruction of students in 


general? 


a. What outcomes does the school use to evaluate DLR use? 
b. Are these or other DLRs being used successfully with ELs in particular? Why or why not? 


c. Are there any additional indicators of successful use of DLRs specifically with ELs students? [If 
yes] What are they? 


d. Are there features or components of these DLRs that you believe have made them useful for EL 
students? 


Professional Development and Support around DLR Use with ELs 


13. 


14. 


15. 


Does your school offer professional development (PD) or support to teachers that focuses on using 
DLRs with students in general? [If yes] Please describe. 


[If the school offers PD or support for teachers, proceed with the following sub-questions; 
otherwise, skip to the next question.] 


a. Who provides this PD or support? 
b. How frequently does the school offer this PD or support? 
c. Is PD or support offered to teachers that specifically concerns the use of DLRs with ELs? 


d. Do the supports mainstream teachers and EL specialist teachers receive related to using DLRs 
for instruction differ? [If yes] Please describe any differences. 


Are there systems or structures in place to facilitate teacher collaboration concerning the use of 
DLRs (e.g., during grade-level team/PLC/COP meeting)? [If yes] Please describe them. 


Do you have suggestions for additional PD or supports that could be offered to teachers to help 
them use DLRs more effectively with ELs? [If yes] What are they? 


Gaps in DLRs 


16. 


17. 


How could DLRs be designed to support the specific learning needs of EL students better? 


a. Are there particular features or functions that you would like DLRs to include that would better 
support your ELs? 


Are there lessons you have learned about using DLRs with ELs that you can share with other 
educators? [If yes] What are they? 


This is the end of the interview. Do you have anything to add regarding DLR use related to ELs or 
students in general? 


Do you have any questions for us? Thank you very much for your time. 
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Teachers Say about Digital Learning Resources for English Learners 


OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 


Mainstream Teacher of English Learner (EL) Students 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this school for instructing English learner, or EL, students. We are 
interested in how you have used DLRs for instruction of ELs—both for language and academic content— 
and for mainstream students as well in the current school year. This information will help us understand 
the similarities and differences between the use of DLRs for the EL and the general student populations. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 
DLRs.] Do you have any questions about these categories? We'll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 
Background Questions 
We’d like to start by learning a little bit about you and the context in which you work. 
1. Tell us about your role and responsibilities. [Obtain response]. 

a. How long have you been a teacher? 

b. What grade levels do you work with? 


c. Approximately how many students do you work with on a weekly basis? 
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2. Of your students, how many are English learners (ELs)? 


a. Please briefly describe the language background and general English proficiency of the ELs in 
your class. 


3. How long have you been working with ELs? 
a. How prepared do you feel to teach the ELs in your classroom? 


b. Do your EL students receive instructional services or supports as a result of their identification 
as ELs? [If yes] What are they? 


4. SCREENER: Do you use DLRs or any form of technology to teach ELs in your classroom? 


[Note to the interviewer: 

If the teacher has EL students in his or her classroom and uses DLRs for teaching ELs, continue with the 
following questions. 

If the teacher has EL students but does not use DLRs, skip the sections on DLR use and identifying DLRs 
and proceed to the section on Barriers.] 


DLR Use with ELs 
5. Which DLRs that you use with ELs? With students in general? 
a. What are your goals for using these DLRs with your ELs? 


b. Are there specific content areas in which you use DLRs to support the instruction of ELs? [If yes] 
What are they? 


6. How frequently do you use DLRs for teaching ELs? 

7. Please walk me through a typical class period when you are using DLRs with ELs. 
a. Do you combine different DLRs at times to teach a particular concept or in a particular lesson? 
b. Do you combine DLR and non-digital activities at times in your classroom? 


8. Are there DLRs that you use exclusively with your EL students, but not with your mainstream 
students? [/f yes] Which ones are they? 


a. Are these DLRs that are designed specifically for ELs? Or are they “mainstream” DLRs that you 
use with ELs? 


9. Are there DLRs that you use with your mainstream students but not with your EL students? [If yes] 
Which ones are they? Why do you use them with mainstream students but not with ELs? 


10. Are there times when you have your ELs work with DLRs that are different from those the rest of 
the class uses? Or work with DLRs when the rest of the class is engaged in another activity? [/f yes] 
Why do you take this approach? 


11. Do you expect your ELs to use DLRs outside of the classroom or at home? [/f yes] Please describe 
what sort of work you require students to do. 


12. Has your use of DLRs influenced your teaching in any way? [/f yes] Please describe any changes that 
have taken place. Has the use of DLRs influenced how you teach your EL students? 


a. Howdo you rate the degree of importance of DLR use for teaching EL students? 


124 


Supporting English Learners through Technology: What Districts and 
Teachers Say about Digital Learning Resources for English Learners 


Identifying DLRs 


13. How do you learn about DLRs that you might use for instruction? 


14. Are you able to choose the DLRs you use for instruction? [If yes] 


a. 


b. 


Which characteristics, features, or functions do you look for in choosing a DLR? 


Do you look for features or functions that differ from those for mainstream students when 
choosing DLRs to use with ELs? 


Are there any DLRs you are required to use by the school or district? Please explain. 


Does school policy allow teachers to request the purchase of new DLRs? Do you ever pay for 
new DLRs yourself? 


Barriers to Using DLRs 


15. [Note to the interviewer: There are two forms of this question. Choose the appropriate form, based 
on the teacher’s response to the screener.] 


Please provide a specific example(s). 


If the teacher uses DLRs If the teacher does not use DLRs 
Have you encountered barriers that make it What are the reasons why you do not use DLRs 
difficult for you to use DLRs with ELs? [If yes] with your students? 


a. Are there any additional reasons why you 
a. Are these same barriers that you face do not use DLRs with your EL students? 
when using DLRs with non-EL students? 


16. Are you aware of challenges that your EL students face when using DLRs outside of the classroom? 
[lf yes] Please describe them. Are you aware of similar or different barriers that your non-EL 
students face? [If yes] Please describe them. 


Professional Development and Support for DLR Use 


17. Do you receive any professional development (PD) or support focused on how to use DLRs? [If yes] 
Please describe the PD and support. 


a. 


Who provides this PD or support? Other than the PD and support provided by the district, do 
you seek any PD or support on your own? [/f yes] Please describe. 


How frequently do you participate in PD related to DLR use? How frequently do you receive 
support related to DLR use? [Support may include coaching, technical support, etc.] 


Is any PD or support specifically focused on how to use DLRs with ELs? [If yes] Please describe 
it. 


What PD or support have you found to be most useful? Why have you found it useful? 
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18. 


19. 


Do you collaborate (or have the opportunity to collaborate) with other teachers on the use of DLRs 
with EL students? 


a. [If yes] |s this collaboration formal (e.g., during grade-level team/PLC/COP meeting), or does it 
take the form of informal sharing? 


b. What type of information or resources do you share when you collaborate? 


c. Do you coordinate with or collaborate with an EL-specialist teacher on how to use DLRs with 
ELs? [If yes] What form does the collaboration take? 


Are there additional PD or supports that you would like to receive to help you use DLRs more 
effectively with ELs? /If yes] What are they? 


Additional Needs and Gaps 


[Note to the interviewer: Please omit this section for teachers who do not use DLRs in their classroom.] 


20. 


21. 


How could DLRs be designed or used to better support the specific learning needs of students in 
general? For ELs? 


a. Are there any features or functions that you would like DLRs to include that would better 
support ELs? 


Are there lessons you have learned about using DLRs with ELs that you can share with other 
educators? [If yes] What are they? 


[At this point, you may ask the teacher to provide a demonstration of one or more of the DLRs that he or 
she uses, using the DLR demonstration protocol. If the teacher is not being asked for a DLR 
demonstration, thank the teacher for his or her time and conclude the interview.] 


This is the end of the interview. 


Do you have anything to add regarding DLR use related to ELs or students in general? 


Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 


English Learner (EL) Specialist Teacher 
Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this school for instructing English learner, or EL, students. Please 
consider the DLRs used in supporting ELs’ learning of both language and academic content. We are 
interested in how you have used DLRs for instruction with ELs in your instruction overall in the current 
school year. We are also interested in general, schoolwide DLR use so that we can understand the 
similarities and differences in DLR use between ELs and the general student population. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview. | 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English Learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 


DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 
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Background Questions 


We’d like to start by learning a little bit about you and the context in which you work. 


1. 


3. 


Tell us about your role and responsibilities. 

a. How long have you been a teacher? 

b. What grade levels do you work with? 

c. Approximately how many students do you work with on a weekly basis? 


d. What are the settings in which you work (e.g., mainstream, self-contained, pull-in, push-out, 
itinerant)? 


e. [If an itinerant teacher] How many schools do you work in? 
f. Do you typically teach non-ELs as well as ELs? 
How long have you been working with ELs? 


a. Could you please briefly describe the language background and English proficiency of the ELs 
you work with? 


b. How prepared do you feel about addressing the needs of ELs? 


SCREENER: Do you use DLRs or any other form of technology to teach ELs in your classroom? 


[Note to the interviewer 

If the teacher uses DLRs, proceed with the following questions. 

If the teacher does not use DLRs, skip the following sections on DLR use and identifying DLRs and proceed 
to the section on Barriers. ] 


DLR Use with ELs 


4. 


Which DLRs do you use with ELs? 

a. What are your goals for using these DLRs with your ELs? 

b. Are there specific content areas in which you use DLRs to support the instruction of ELs? 

How frequently do you use DLRs for instructing ELs? 

Please walk me through a typical class period when you are using DLRs with ELs. 

a. Do you combine different DLRs at times to teach a particular concept or in a particular lesson? 
b. Do you combine DLR and non-digital activities at times in your classroom? 


[If teacher works with non-ELs] Are there DLRs that you use exclusively with your EL students, but 
not with your mainstream students? [If yes] Which ones are they? 


a. Are these DLRs that are designed specifically for ELs? Or are they “mainstream” DLRs that you 
use with ELs? 
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8. [If teacher works with non-ELs] Are there DLRs that you use with your mainstream students but not 
with your EL students? [If yes] Which ones are they? Why do you use them with mainstream 
students but not with ELs? 


9. [If teacher works with non-ELs] Do you ever have your ELs work with DLRs that are different from 
those the rest of the class uses or work with DLRs when the rest of the class is engaged in another 
activity? [If yes] Why do you take this approach? 


10. Do you expect your ELs to use DLRs outside of the classroom or at home? [If yes] Please describe 
what sort of work you require students to do. 


11. Has your use of DLRs influenced how you teach ELs? [/f yes] Please describe. 
a. How do you rate the degree of importance of DLR use for the instruction of EL students? 
Identifying DLRs 
12. How do you learn about DLRs that you might use for instruction? 
13. Are you able to choose the DLRs you use for instruction? [If yes] 


a. Which characteristics, features, or functions do you look for when choosing a DLR to use with 
ELs? 


b. [If teacher works with non-ELs] Do you look for different features or functions when choosing 
DLRs to use with non-ELs? 


c. Does school policy allow teachers to request the purchase of new DLRs? Do you ever pay for 
new DLRs yourself? 


d. Are you required by your school or district to use specific DLRs? [If yes] Please explain. 
Barriers to Using DLRs 


14. Have you encountered barriers that make it difficult for you to use DLRs with ELs? Please provide a 
specific example. 


15. Are you aware of challenges that your EL students face when using DLRs outside of the classroom? 
[If yes] Please describe. 


a. [lf teacher works with non-ELs] Are these challenges the same for your non-EL students? 


Professional Development and Support for DLR Use with ELs 


16. Do you receive any professional development (PD) or support focused on using DLRs with ELs? [If 
yes] Please describe the PD and support. 


a. Who provides this PD or support? Other than the PD and support provided by the district, do 
you seek any PD or support on your own? 


b. How frequently do you participate in PD related to DLR use with ELs? How frequently do you 
receive support related to DLR use with ELs? [Support may include coaching, technical support, 
etc.] 


c. What PD or support have you found to be the most useful? Why have you found it useful? 
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17. Do you collaborate with other teachers on the use of DLRs with EL students? [If yes] 


a. Is the collaboration formal (e.g., during grade-level team/PLC/COP meeting), or does it take the 
form of informal sharing? 


b. What type of information or resources do you share when you collaborate? 


c. Do you coordinate with or collaborate with general education teachers on how to use DLRs 
with EL student(s)? For example, do you advise general education teachers about the DLRs they 
can use with their EL students? 


18. Are there additional PD or supports that you would like to receive to help you use DLRs more 
effectively with ELs? [If yes] What are they? 


Additional Needs and Gaps 
19. How could DLRs be designed or used to support the specific learning needs of EL students better? 


a. Are there any features or functions that you would like DLRs to include that would better 
support your ELs? 


20. Are there lessons you have learned about using DLRs with ELs that you can share with other 
educators? [If yes] What are they? 


[At this point, you may ask the teacher to provide a demonstration of one or more of the DLRs that he or 
she uses, using the DLR demonstration protocol. If the teacher is not being asked for a DLR 
demonstration, thank the teacher for his or her time and conclude the interview.] 

This is the end of the interview. 

Do you have anything to add regarding DLR use related to ELs or students in general? 


Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 


National Study of English Learners and Digital Learning Resources (NSELD) 


School Instructional Technology (IT) Specialist or Coach 


Interview Protocol 


Our interview today focuses on how technology resources, or as we term them, Digital Learning 
Resources, or DLRs, are used in this school for instructing English Learner, or EL, students. We are 
interested in the DLR use in supporting EL students’ learning of both language and academic content in 
the current school year. We are also interested in general DLR use to enable us to understand the 
similarities and differences in the use of DLRs between the EL and the general student populations. 


Before we continue, | would like to review our consent form with you. [Note to interviewer: Hand 
interviewee the consent form and highlight the following information: (1) the study team will protect or 
maintain confidentiality for data collected, except as required by law; (2) only the study team will have 
access to data with identifiable information; (3) responses will be aggregated; and (4) no individual will 
be identified by name in any reporting. After reviewing these highlights, please ask the respondent to 
read and sign the form before proceeding with the interview.] 


Definitions 


Digital Learning Resources (DLRs) refer to digital resources such as applications (apps), software, 
programs, or websites that engage students in learning activities and support students’ learning 

goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and 
digital communication tools. Individual DLRs from the different categories may be combined ina 
comprehensive package of DLRs (an “integrated DLR set”). This might be, for example, a comprehensive 
set of related resources that a district licenses from a DLR publisher. (Note that DLRs as we define them 
are separate from and do not include the hardware or devices used). 


English Learner (EL) refers to students not born in the United States or students whose native language 
is other than English and students who come from non-English-dominant environments, whose skills in 
English are so limited that they derive little benefit from regular school instruction. English learner also 
refers to students who have no proficiency in English. Note: If your district has an operational definition 
for EL students, then use your district’s definition in responding. 


[Note to interviewer: Hand interviewee the definitions sheet and briefly review the three categories of 
DLRs.] Do you have any questions about these categories? We’ll be using them in some of our questions 
in the interview today. Please feel free to refer to this sheet throughout the interview. 

Background Questions 

We’d like to start by learning a little bit about you and the context in which you work. 

1. Tell us about your responsibilities related to use of technology in the school. 


a. How did you become the technology coach? Were you ever a teacher? 
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2. How do you support teachers or staff in using technology? 
a. Do you assist mainstream teachers who instruct ELs? 
b. Do you assist EL specialist teachers (i.e., teachers who provide English as a Second Language, 
bilingual, or other instruction specifically designed for EL students)? 
3. How comfortable do you feel about using technology to support the needs of ELs? 
a. What training have you received, if any, that is specific to working with EL students? 
4. Does the district or school have a technology plan in place that guides your work? 
[If yes, proceed with the following sub-questions, if no, skip to the next question.] 
a. What are the technology goals in the plan, in general? 
b. Does the plan set forth specific technology goals related to ELs? 
c. Do any technology goals in the plan relate specifically to how DLRs can be used to engage the 
families of ELs? If so, what are they? 
DLR Use with ELs 
5. What is the extent of DLR use in the school? For example, are DLRs currently used in all grades, 
subjects, and special programs? 
6. Does the school use DLRs that specifically address the needs of ELs? 
[If yes, ask the following sub-questions. If no, proceed to the next question.] 
a. Please tell me about these DLRs. 
b. Why are these DLRs used? 
c. Are these DLRs intended to be used by mainstream teachers, EL-specialist teachers, or both? 
d. What are some of the features or functions (e.g., read-aloud functions, translation, first- 
language support) of DLRs that make them useful to teachers for supporting ELs? 
7. Can you tell me about some of the DLRs teachers use in the school with students in general? 
a. Why are these DLRs used? 
b. Are these DLRs intended to be used by mainstream teachers, EL-specialist teachers, or both? 
8. Are you aware of whether teachers use some DLRs with their non-EL students that they do not 


typically use or that they use differently with their EL students (or vice-versa)? 
a. [If yes] Are you aware of which ones they are? 


b. Are you aware of why teachers use these DLRs with mainstream students but not with ELs (or 
vice-versa)? 


Professional Development and Support for DLR Use with ELs 


9. 


Do you provide any coaching, professional development (PD), or support for teachers that focuses 
on using DLRs with ELs? 


a. If so, what types of support do you provide? 
b. How frequently do you provide these supports? 


c. Do you provide different supports to mainstream teachers and EL specialist teachers? [If yes] 
Please explain the differences. 
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10. What, if any, PD or support do you provide to teachers that focus on using DLRs in general? Please 
describe it. 


Barriers to DLR Use 


11. Have you observed barriers, such as lack of hardware or connectivity, to teachers’ use of DLRs in 
general and for EL students specifically? 


12. Are you aware of any barriers that students or parents face when they use DLRs at home? If so, are 
you aware whether these barriers are the same for ELs and their families as for mainstream 
students? 


Identifying, Selecting, and Purchasing DLRs 
13. How do you identify and select DLRs that you recommend to teachers? 


a. Do you look for specific characteristics or features when you are choosing a DLR to 
recommend? [If yes] What are they? 


b. Do the DLRs you recommend for use with EL students differ from those you recommend for 
mainstream students? [If yes] In what way? 


14. Are there any specific DLRs that school leadership or the district specifically require as part of the 
curriculum? 


a. Are there any DLRs that school leadership or the district encourages—rather than requires— 
teachers to use? 


Evaluation of DLR Use 
15. Do you evaluate the school’s use of DLRs? /If yes] Please describe how you evaluate them. 
a. Are you aware of the outcomes used to evaluate the use of DLRs? /If yes] What are they? 


b. Are you aware of additional indicators used to determine whether DLR use is successful with EL 
students? /If yes] What are they? 


Gaps in DLRs 


16. How could DLRs be designed or used to better support the specific learning needs of students in 
general? For ELs? 


a. Are there any features or functions that you would like DLRs to include that would better 
support ELs? 


17. Are there lessons you have learned about using DLRs with students in general that you could share 
with other educators? Lessons you have learned about using DLRs with ELs? /If yes] What are they? 


This is the end of the interview. 
Do you have anything to add regarding DLR use in your district or DLR use related to EL students? 


Do you have any questions for us? 


Thank you very much for your time. 
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OMB 1875-0279 
National Study of English Learners and Digital Learning Resources (NSELD) 


DLR Demonstration Protocol 


Name: Title: 

School: District: State: 
Email: Phone Number: 

Interview Date: Time: Interviewed by: 


Instructions for researchers 

The Digital Learning Resource (DLR) Demonstration will be used, in most cases, as part of the teacher 
interview, although there might be some instances in which we may decide to ask teachers that we have 
not interviewed to give us a demonstration of a DLR they use. 


Introduction 


We’re interested in seeing a brief demonstration of one of the DLRs that you commonly use for 
teaching. This can be a DLR you use in class or assign for home use or both. If time allows, it would be 
great to see more than one DLR. Could we begin with the DLR or set of DLRs that you use most 
commonly? This can be a DLR that you use exclusively with English learner (EL) students or one that you 
use with all students, including ELs. 


1. What is the name of this DLR? [Note that if teachers use more than one DLR at once, make note of 
all DLRs included. ] 
2. How would you categorize this DLR [refer to Definitions sheet]? 
3. How did you learn about it? How long have you been using it? 
a. Did you choose to use this DLR or are you required by the school or the district to use it? 
4. Do you typically use this DLR with your ELs, non-ELs, or both populations? 
5. How often do you use this DLR in your teaching? 


6. What are the purposes served by the DLR /e.g., Introducing concepts, providing opportunities for 
practice, improving engagement, etc.]? 
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7. Tell us about how you use this DLR in your teaching. [During this set of questions, ask the teacher to 
show how he/she uses the DLR as he/she answers.]| 


a. What are some of the things that you ask students to do with this DLR? 

b. [lf applicable] How do you assign students to different levels in this DLR? 

c. Do students use this DLR individually, in small groups or pairs, or in whole class? 
d. What kind of feedback and support does the DLR provide to students? 


e. What is your process for monitoring what students are doing in this DLR? 


f. How do you know what students are learning as a result of working on this DLR? 
g. How do you use that information in your teaching? 
h. Do you use this DLR in combination with other DLRs? If so, please tell us which other DLRs you 


use with this one, and how you combine them to support EL students’ learning. [Not necessary 
if they start by telling about a combination of DLRs.] 


i. Doyou use this DLR in combination with other non-digital activities to address the same 
knowledge or skills? If so, please show me how you do so. 


j. [lf teacher indicated that he/she uses DLRs with ELs and non-ELs] Do you use this DLR 
differently with your ELs and non-ELs? 


8. What do you consider as indicators of successful use of this DLR? 
9. What are some of the things that your students like about using this DLR? 

a. Are there particular things your EL students like about this DLR? If so, what are they? 

b. Are there any features of this DLR that are especially beneficial to ELs? If so, what are they? 
10. Do your students face any challenges while working on this DLR? If so, what are they? 


a. In your view, are there supports that could be included in the DLR to make it easier or more 
beneficial for EL students? If so, what are they? 


11. Are there any barriers that prevent you from using this DLR? If so, what are they? 
a. What kinds of supports might make it easier or more beneficial for you to use this DLR? 
12. Would you recommend this DLR to a colleague for use with his/her ELs? 


[If there is time and it is appropriate (i.e., the teacher has mentioned other DLRs in the interview), ask the 
teacher to select and demonstrate another DLR. Repeat questions 1-13 during the demonstration. 

At the end of the demonstration, ask the teacher if he or she has additional questions and thank the 
teacher for his or her time.] 
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National Study of English Learners and Digital Learning Resources (NSELD) 
Classroom Observation Protocol 
Instructions for Observers 


e Please observe for one full class period or a content block in elementary school or for one hour if 
classes are longer than an hour. 


e Ask the teacher to recommend up to four focal students to observe. Teachers will be told to base this 
recommendation on students who are considered typical EL students for this school. Use your 
observations of focal students to complete item 3 (student actions using DLRs and teacher actions 
supporting students’ use of DLRs) and item 4.2. Highlight the focal students in your narrative 
summary of the lesson (item 5). 


e Complete this form based on the behaviors and events that you actually see in the classroom, 
rather than including what students might have done previously or what you think the teacher is 
trying to do. 


Background 
Observer(s): 
Observation date: DD /MM /YYYY Observation start time: 
Length of observation (minutes): Observation end time: 
School name: District: 
Teacher ID: 
Number of students: Number of EL students: 


Number of focal students: 


Briefly describe the language background and proficiency level of the EL students in the class: 


(If possible, ask the teacher about the language background and proficiency level of the EL students in the class 
before the period begins. If not possible, pull in relevant data from their interview.) 


Grade level: 


Subject: (Mark all that apply.) 


1 a. Mathematics 


Cb. English language arts/reading 


Oc. Science 


O d. Social studies, history, government 


Oe. English language development (ELD) 


Cf. Interdisciplinary (describe): 


C1 g. Other (describe): 


Teacher’s stated instructional goals/learning objectives and reasons for DLR choices and uses: 


(If possible, ask the teacher about the lesson goals before class begins. If that is not possible, write down any 


goals that are stated or posted in the class.) 
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1. Technology Resources 


Note the technology resources that were (1) present in the room and (2) used by teachers or students for class- 


related activities during the observation period. Record any relevant notes, such as how the technology was used, 


in (3). RQ 2 (2.1, 2.3) 


Resource 


a. | Computers 
(e.g., desktop, laptop, 
tablet, etc.) 


b. | Technology peripherals 
(e.g., printer, projector) 


(e.g., emails, list serves, 
discussion boards) 


c. Internet tools & resources 


(1) Present in 
room? 


LI ves 
LI) no 
LD) unsure 
LI ves 
LI) no 
CL) unsure 


d. | Other hardware or 
infrastructure 

(e.g., mobile phones, 
probes, digital camera) 


(2) Used during class? 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


(3) Notes about the technology 
used 


Include number of computers 
used, stand-alone or networked. 
Note whether this is a 1-1 
classroom. 


e. | Digital Academic Content 
Tools 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


f. | Digital Productivity Tools 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


g. | Digital Communication 
Tools 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


h. | Integrated DLR set 


LJ Yes, by teacher 


LJ Yes, by students 


LJ no 


LJ Yes, by teacher 


LJ Yes, by students 


LI no 
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e Where did the observed lesson take place? 


C] a. In the regular classroom 

fac ia. 
LO C. In a pullout classroom or resource room 
a. 222  .<.°9.9.$°'“—<.$—“1 


e Classroom setup/arrangement of student seats and desks: (Mark all that apply.) RQ 3 (3.3) 


CT] : Students are seated individually, in rows 

CT] b. Students are sitting at tables, facing forward 
CT] . Students are sitting in groups, facing each other 
T] y Other (Please describe): 
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2. Teacher and Student Actions 
2.1. Activity structure (Mark all that apply and below note the dominant activity on which the most students spent 


the most time during the observation. If you like to provide any additional information about the items you 


selected, please add notes to Section 2.1a.) 


Whole-class, teacher-led activity: the teacher or another adult directed a whole-class activity, gave a 


La. 


lecture, etc. 


Ls. 


Whole-class, student-led activity: students directed a whole-class activity, facilitated a discussion, 
etc. 


Small-group or pair activity: students worked together in groups or pairs. 


Individual activity: students completed a worksheet, worked on a problem, read, worked 
individually on computers, etc. 


Other (describe): 


2.1a. Additional notes on activity structures 


2.2. Teacher roles/actions (Mark all that apply and pick the dominant role in which the teacher spent the most 


time during the observation. If you like to provide any additional information about the items you selected, 
please add notes to Section 2.2a.) 


La. 


The teacher presented information: the teacher gave instructions, lectured, reviewed assignments 
or tests, demonstrated how to do something, or otherwise gave information. The teacher did most 
of the talking, although he or she may have asked some factual-recall questions. 


The teacher facilitated an activity or discussion: the teacher led the class in an activity or discussion. 
Dialogue principally occurred between the teacher and student rather than between students. 


The teacher monitored student progress and behavior: the teacher moved around the room, 
answered procedural questions, gave encouragement, and/or ensured that students were on task. 


The teacher assisted an individual student: the teacher provided in-depth support to a single 
student to help them log onto the computer, start an activity, answer questions, and/or check for 
understanding, etc. 


The teacher participated in a student-led activity: the teacher acted as a participant in a discussion 
or activity that was mainly led by students. 


Other (describe): 


pO 


2.2a. Additional notes on teacher roles/actions 
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For each DLR used in this lesson, please complete one row in the following table. 

Name of the DLR Knowledge and skills DLR learning activity Student actions Teacher actions 

addressed by the DLR structure What were EL students doing How was the teacher supporting EL 
while using the DLR? students’ use of the DLR? 


0 Individual 

CX Pairs 

C1 Small groups 
OX Whole class 


Tvl 


0 Individual 

CO Pairs 

C1 Small groups 
OX Whole class 


0 Individual 

OO Pairs 

CO Small groups 
OO Whole class 


0 Individual 

XO Pairs 

C1 Small groups 
OX Whole class 


yoday jeulj :ssausea7 Yysi|3uq 40} sadunosay Buluseay jeusiq ynoge Aes suayseal 
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4. Use of Digital Learning Resources 


4.1 For what purpose(s) did the teacher use Digital Learning Resources? (Mark all that apply.) RQ 3 (3.1, 3.2) 


The teacher used DLRs to... With all students, With ELs, in 
including ELs particular 
a. | Present new concepts or skills to students in language CT] CT] 


domains (reading, writing, listening, speaking) 


b. | Present new concepts or skills to students in academic 
content areas 


c. | Present students with a problem-solving activity 


d. | Demonstrate academic content or concepts (e.g., using 
3-D simulations or dynamic representations) 


e, | Demonstrate how students could model phenomena 
(e.g., convert their understandings to a computer model 
for testing and iteration) 


f. | Ask students to create a product using multimedia design 
(e.g., video, poster) to demonstrate learning 


g. | Ask students to write an essay or a report 


h. | Communicate with others outside of the classroom 
(e.g., email, blogs, video chat, text) 


j. | Collaborate with others inside or outside the classroom 
(e.g., collaborative workspaces, wikis, etc.) 


j. | Involve students in assessment activities 


k. | Adapt or differentiate activities based on students’ needs 


|. | Track students’ progress in completing an activity 
(e.g., using an integrated learning system) 


m, | Demonstrate how students will use technology 


n. | Communicate or exchange resources with students 

(e.g., distributing assignments or resources electronically, 
collecting homework, or using a content management 
system) 


o. | Track individual student performance on standards or skills 


p. | Conduct classroom administration (e.g., grading, 
attendance) 


q. | Other (Please describe): 


O oO}oO;}] O |O);O;O;O;} OO; O;O;0; OF OF;O/; 0 
O o;O}; O |O;oO;O/;O} OO; 0O;O; 0; OF oF; 0 
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4.2 For what purpose(s) did the students use Digital Learning Resources? (Mark all that apply.) RQ 3 (3.1, 3.2) 


Students used DLRs to... All students, ELs, in particular 
including ELs 
qa. | Learn new concepts or skills in language domains CT] CT] 


(reading, writing, listening, speaking) 


b. | Learn new concepts or skills in academic content areas 


c. | Practice skills and procedures in language domains 


d. | Practice skills and procedures in academic content 
areas 


e, | Work on a problem-solving activity 


f. | Gather qualitative data (e.g., document observations) 
or quantitative data (e.g., take measurements using 
probes) 


g. | Analyze or synthesize data or information (e.g., using a 
data visualization tool to identify a pattern or trend) 


h. | Write or edit stories/reports/essays using word 
processing 


j. | Take notes 


j. | Create presentations 


k. | Create multimedia products (e.g., videos) 


|. | Find information on the Internet 


m.| Communicate with others outside of the classroom 
(e.g., email, blogs, video chat, text) 


n. | Collaborate with others inside or outside the 
classroom (e.g., collaborative workspaces, wikis, etc.) 


o. | Complete assessment activities 


p. | Turn in homework assignments or other class work 


q. | Other (Please describe): 


Oho;O}; OO); O;/O/;O;/O;O;O;0O}; OyO;oO;o 
Oo;O;O)O;O/;/O/0O;/0/0;/0; OF O;o0;o 
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5. Lesson Summary 


Please provide a brief (~2 paragraphs) summary of the lesson. In this summary, describe how the teacher 
used DLRs with the focal EL students you observed and, if possible, the extent to which this was different from how 
the teacher used DLRs with the class in general. Please also describe how or if the teacher used DLRs to 
differentiate instruction for students, used more than one DLR, combined DLRs and non-digital learning experiences 
to address specific knowledge or skills. Please also provide a brief description of the students’ level of engagement 
in the DLR and the overall lesson (e.g., Did the students seem bored when using the DLR or during the class activity? 
Were they attentive to the lesson? Did they enthusiastically engage with the DLR?). 
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Appendix E. 
Digital Learning Resource Matrix and 
Digital Support Features Matrix 
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Digital Learning Resource (DLR) Matrix 


The term Digital Learning Resources (DLRs) refers to digital resources such as applications (apps), software, programs, or websites that engage students in learning activities and 
support students’ learning goals. There are three categories of DLRs: digital academic content tools, digital productivity tools, and digital communication tools. DLRs as defined 
here do not include the hardware or infrastructure needed to use the digital resources. 


DLR Category Definition Category Types and Examples 
Software, applications e Interactive tutorials or lessons (adaptive and other) that guide students in learning and demonstrating new content or skills, 
(apps), programs, or such as an interactive lesson on the life cycle of a butterfly or a math tutorial on fractions. 
websites that offer Practice and assessment tools that provide activities to review concepts and skills, such as a math app that provides multiple 
academic content Designed opportunities to practice addition skills. 
ee angios oleae learning activities e Dynamic modeling or simulation tools, such as a physics simulation that lets students manipulate virtual equipment, change 
students in activities to 
ep . parameters, and see the results. 
Digital learn academic content or 7 : : : : : : : 
Academic skills, including, but not e Virtual worlds that immerse a student in a fully interactive environment, such as one that allows a student to roam in a period 
Content limited to, language and of past history or explore a desert environment. 
Tools literacy content or skills. e Dictionaries, encyclopedias, e-books, topic blogs, and/or topic-focused websites that serve as information resources, such as 
References/ an online encyclopedia that offers students pictures, facts, and videos about mammals or a digital dictionary. 
resources 
e Visual and auditory topic-related resources such as a YouTube video on earthquakes and plate tectonics. 
e Translation tools that assist students by providing a translation to another language. 
Language resource f . : ‘ ere 
tools e Articulation tools that assist a student to accurate production of a language, such as by showing images of how a sound should 
be produced and/or by letting a student record and listen to his/her own voice to compare with the model. 
Software, applications : e Presentation and publication tools that allow students to demonstrate what they have learned about a topic or to publish a 
Presentation tools = : ine is : 
(apps), programs, or digital story about a memorable day. These may include music, images, and/or video. 
websites that students use : e Word or text processing tools that enable students to create, edit, and print documents such as in creating a newspaper based 
to plan, document Word processing tools : f P ? : 
iqital mM . ; on topics from history class or reporting on a field trip. 
Digita ? Ofsenize, .and.anaiyze Information e Spreadsheet and data analysis tools that allow students to organize and analyze information, such as tracking local rainfall 
Productivity conrenE INey eee lysis tool over time or analyzing and summarizing factors that led to the migration from the American Dust Bowl to the West in the 1930s 
Tools contain academic content. CHEWAS WOuIs 
e Concept-mapping tools that let students visually represent relationships among sets of information, such as creating a 
Information mindmap of the American Revolution or a concept map for the causes of the Civil War. 
organization tools e Story templates that assist students to communicate a narrative using text and/or images, as in retelling a story they have 
heard. 
Software, applications Asynchronous/ e Discussion boards or forums that provide platforms for students to post reactions and/or comments and share perspectives, 
(apps), programs, or synchronous such as in providing analyses of a novel they have read and sharing feedback on their peers’ analyses. 
websites that students use| text communications _|e Emails, text messaging, chats, for example, using a chat function to share peer feedback ona report. 
to communicate, 
Digital collaborate, network, or Reflection e Blogs or student journals that allow students opportunities to share and/or reflect on their learning experiences, such as a 
Communication |Present information. They tools student who uses a journal entry to reflect on her understanding of particular math concepts. 
Tools do not contain academic Vid f ings e Videoconferencing or meeting tools that provide a remote means of seeing and speaking with others in real time, such as in 
content. ! ene reciee enabling a science class to see and talk with NASA experts, or allowing students in a Spanish dual-language class to see and 
share a geography game with Spanish-speaking peers in Mexico. 
Project collaboration eDocument or project-sharing tools that provide an online platform where students can work on products together, as in jointly 
tools editing a shared book report. 


Integrated 
DLR 
Sets 


Multiple individual DLRs can be combined in an Integrated DLR Set 


A structured combination of individual 


DLRs to provide a complete core or 
supplemental curriculum. Often, DLR 
sets are licensed as a package by a 


school district. 


Core Curriculum Integrated DLR Set 


¥ 


For example, a math program for grades 6-8 that combines visual lessons with embedded 
assessments, productivity tools, and flexible class management tools into one package. 


Supplemental Integrated DLR Set 


For example, a math intervention for at-risk students in grades 6-12 that provides tutorials, 
practice activities, and progress monitoring tools to inform instruction. 


Note: This summary matrix was adapted from Zehler, Annette M., Yilmazel-Sahin, Yesim, Massoud, Lindsey, Moore, Sarah C., Yin, Chengbin, and Kramer, Kat. (2012, April). Technology-based resources in instruction of 


English learner students. Poster presentation at the Annual Meeting of the American Educational Research Association, Vancouver, British Columbia. 


Source: U.S. Department of Education, Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service. (2018). National Study of English Learners and Digital Learning Resources. Washington, DC: 


Author. 
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Digital Support Features Matrix 


Digital Support Features are specific embedded features in digital learning resources (DLRs) that assist students in understanding or communicating the content and/or 
activities provided in the DLR. This is a preliminary list to prompt further discussion among developers and educators. 


Support Feature 
Category 


Visual 
Support 
Features 


Auditory 
Support 
Features 


Translation 
Support 
Features 


Collaboration 
Support 
Features 


Definition 
Provide visual images or other 
visual supports to assist a 
student in understanding 
and/or communicating a 
concept or idea. 


Provide speech or other use of 
sound to assist a student in 
understanding and/or 
communicating a concept or 
idea. 


Provide embedded functions to 
translate from one language to 
the other, in either speech or 
print, and for either a word or 
limited text. 


Embedded functions that 
students use to communicate, 
collaborate, work, or share 
information about academic 
content. 


Category 


Visual definition 


Interactive visual features 


Examples 
Links to a video or image(s) providing a visual definition of a concept or word. 


Manipulable visual representation of a concept, such as a graphing calculator feature integrated into a DLR, providing 
representations of concepts based upon information that a student enters. 


Closed captioning 


Auditory definition 


Text shown on the video screen provides print as well as audio that is useful for English learners still developing their 
ability to understand spoken English. 


Allows students to click on a word to hear a definition of a concept or word. 


Text-to-speech for text 
selection 


Text-to-speech for 
highlighted word 


Reads aloud text such as a selection on academic content, a story, directions for a lab experiment, or math questions; 
might include options to play, pause, adjust the volume, and/or control the speed at which the text is read. The 
language used may be English or another language, depending on the materials used. 


Allows readers to hear an individual word or phrase. 


Record and replay voice 


Spoken word translation 


Enables students to record their voice; replay it so that they can hear their own voice, perhaps make adjustments to 
and/or practice pronunciation, practice their part in a presentation, or save for sharing with others. 


Enables a student to hear a spoken translation in his/her home language of an unfamiliar English word. 


Printed word translation 


Enables a student to view a written translation in his/her home language of an unfamiliar English word. 


Spoken text translation 


Enables a student to hear spoken statements in one language as spoken in another language. 


Printed text translation 


Document sharing 


Enables a student to view a section of text in one language as written in another language. 


Allows multiple students to share a digital document and use annotation tools to add notes or comments. 


Collaboration based on 
proficiency level 


Allows students to collaborate with peers according to their proficiency levels (e.g., peers at the same Lexile reading 
comprehension level). 


Note: This matrix is a preliminary summary of supports created for the toolkits based on insights gained through the NSELD research. 
Source: U.S. Department of Education, Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service. (2018). National Study of English Learners and Digital Learning Resources. Washington, 


DC: Author. 
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The Department of Education’s mission is to promote student achievement and preparation 
for global competitiveness by fostering educational excellence and ensuring equal access. 
NVAWAY =e SX0NV7 


